[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:37:38 dist-test-slave-8w9v krb5kdc[26841](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:37:38 dist-test-slave-8w9v krb5kdc[26841](info): set up 2 sockets
Aug 07 22:37:38 dist-test-slave-8w9v krb5kdc[26841](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 22:37:39.791793 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:37:39 dist-test-slave-8w9v krb5kdc[26841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:37:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:37:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:37:39.915416 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:38757
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:38757
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:40.035323 26856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:40.035596 26856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:40.035640 26856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:40.039646 26856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:37:40.039719 26856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:40.039743 26856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:40.039762 26856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:37:40.039837 26856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:37:40.045426 26856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:38757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:38757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:40.046949 26856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:40.048300 26856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:40.060719 26862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:40.060748 26865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:40.060962 26856 server_base.cc:1034] running on GCE node
W20260807 22:37:40.062494 26863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:40.063150 26856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:40.064960 26856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:40.066145 26856 hybrid_clock.cc:648] HybridClock initialized: now 1786142260066127 us; error 85 us; skew 500 ppm
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:40.069161 26856 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:37:40.070282 26856 webserver.cc:460] Webserver started at http://127.26.52.126:36307/ using document root <none> and password file <none>
I20260807 22:37:40.070888 26856 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:40.070989 26856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:40.071317 26856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:40.073477 26856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "758c6c03fad84011b7373056412caa31"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "08bc4058843f4776a7339fe7d441a6bb"
server_key_iv: "c8b5dc66e421ed1a879dae6ec83e4792"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.074047 26856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "758c6c03fad84011b7373056412caa31"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "08bc4058843f4776a7339fe7d441a6bb"
server_key_iv: "c8b5dc66e421ed1a879dae6ec83e4792"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.078095 26856 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:37:40.080592 26872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:40.081756 26856 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:40.081941 26856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "758c6c03fad84011b7373056412caa31"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "08bc4058843f4776a7339fe7d441a6bb"
server_key_iv: "c8b5dc66e421ed1a879dae6ec83e4792"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.082057 26856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:40.107152 26856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:40.110761 26856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:40.111013 26856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:40.120004 26856 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:38757
I20260807 22:37:40.120055 26927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:38757 every 8 connection(s)
I20260807 22:37:40.121291 26856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:37:40.125180 26928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:40.131577 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 26856
I20260807 22:37:40.131699 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:37:40.132042 26928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31: Bootstrap starting.
I20260807 22:37:40.133059 26833 external_mini_cluster.cc:1428] Setting key 22966a72ae156d5c8d19b5cdfe6b8c91
I20260807 22:37:40.134824 26928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:40.135901 26928 log.cc:824] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:40.138552 26928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31: No bootstrap required, opened a new log
I20260807 22:37:40.143499 26928 raft_consensus.cc:348] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758c6c03fad84011b7373056412caa31" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38757 } }
I20260807 22:37:40.143853 26928 raft_consensus.cc:374] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:40.143915 26928 raft_consensus.cc:729] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 758c6c03fad84011b7373056412caa31, State: Initialized, Role: FOLLOWER
I20260807 22:37:40.144556 26928 consensus_queue.cc:260] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758c6c03fad84011b7373056412caa31" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38757 } }
I20260807 22:37:40.144723 26928 raft_consensus.cc:388] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:37:40.144891 26928 raft_consensus.cc:482] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:37:40.145030 26928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:40.145951 26928 raft_consensus.cc:504] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758c6c03fad84011b7373056412caa31" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38757 } }
I20260807 22:37:40.146384 26928 leader_election.cc:302] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 758c6c03fad84011b7373056412caa31; no voters:
I20260807 22:37:40.146756 26928 leader_election.cc:288] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:37:40.146881 26933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:40.147135 26933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [term 1 LEADER]: Becoming Leader. State: Replica: 758c6c03fad84011b7373056412caa31, State: Running, Role: LEADER
I20260807 22:37:40.147508 26933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758c6c03fad84011b7373056412caa31" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38757 } }
I20260807 22:37:40.148255 26928 sys_catalog.cc:564] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:37:40.149888 26934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "758c6c03fad84011b7373056412caa31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758c6c03fad84011b7373056412caa31" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38757 } } }
I20260807 22:37:40.150053 26934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:40.150431 26935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 758c6c03fad84011b7373056412caa31. Latest consensus state: current_term: 1 leader_uuid: "758c6c03fad84011b7373056412caa31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758c6c03fad84011b7373056412caa31" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38757 } } }
I20260807 22:37:40.150527 26935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31 [sys.catalog]: This master's current role is: LEADER
W20260807 22:37:40.153970 26949 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:37:40.154100 26949 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:37:40.154178 26944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:37:40.155189 26944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:40.161584 26944 catalog_manager.cc:1347] Generated new cluster ID: 7a151eee8e524dd0b174ed1f063efdb8
I20260807 22:37:40.161701 26944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:37:40.162910 26931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:40.137009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46834 (local address 127.26.52.126:38757)
0807 22:37:40.137532 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:40.137598 (+ 66us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:40.138979 (+ 1381us) server_negotiation.cc:407] Connection header received
0807 22:37:40.142882 (+ 3903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:40.142915 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:40.143331 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:40.143703 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:40.146485 (+ 2782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.148042 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.150085 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.150921 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.151076 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:40.156680 (+ 5604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:40.156727 (+ 47us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:40.156744 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:40.156779 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:40.159191 (+ 2412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.159776 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.159780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.159784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.159894 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.160377 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.160381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.160382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.161018 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:40.161270 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:40.161940 (+ 670us) server_negotiation.cc:299] Negotiation successful
0807 22:37:40.162210 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":136,"threads_started":1}
I20260807 22:37:40.176532 26944 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:37:40.177438 26944 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:37:40.183651 26944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 758c6c03fad84011b7373056412caa31: Generated new TSK 0
I20260807 22:37:40.184484 26944 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:37:40.217254 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38757
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:40.357797 26955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:40.358034 26955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:40.358095 26955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:40.362098 26955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:40.362152 26955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:40.362210 26955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:37:40.367771 26955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:40.368790 26955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:40.369824 26955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:40.379901 26965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:40.379923 26962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:40.380019 26955 server_base.cc:1034] running on GCE node
W20260807 22:37:40.379926 26963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:40.380599 26955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:40.381213 26955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:40.382395 26955 hybrid_clock.cc:648] HybridClock initialized: now 1786142260382365 us; error 53 us; skew 500 ppm
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:40.385295 26955 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:37:40.386231 26955 webserver.cc:460] Webserver started at http://127.26.52.65:33279/ using document root <none> and password file <none>
I20260807 22:37:40.386868 26955 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:40.386962 26955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:40.387198 26955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:40.389285 26955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "be2159a5c89349c4b3cf8d4fc8d91419"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "4c8ac3b006869899ded07a100bc37685"
server_key_iv: "aaa32219d702fda1026543abefe5ffe0"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.389851 26955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "be2159a5c89349c4b3cf8d4fc8d91419"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "4c8ac3b006869899ded07a100bc37685"
server_key_iv: "aaa32219d702fda1026543abefe5ffe0"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.393687 26955 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:37:40.396085 26972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:40.397396 26955 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:37:40.397536 26955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "be2159a5c89349c4b3cf8d4fc8d91419"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "4c8ac3b006869899ded07a100bc37685"
server_key_iv: "aaa32219d702fda1026543abefe5ffe0"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.397652 26955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:40.419922 26955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:40.423355 26955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:40.423591 26955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:40.424352 26955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:40.425521 26955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:40.425597 26955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:40.425673 26955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:40.425719 26955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:40.434545 26955 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:33983
I20260807 22:37:40.434618 27108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:33983 every 8 connection(s)
I20260807 22:37:40.435473 26955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:37:40.444788 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 26955
I20260807 22:37:40.444931 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:37:40.445194 26833 external_mini_cluster.cc:1428] Setting key 66a0e99a2cacb2b3f4fa503a21e95caf
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:40.449698 26931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:40.437563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:43753 (local address 127.26.52.126:38757)
0807 22:37:40.437716 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:40.437721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:40.438550 (+ 829us) server_negotiation.cc:407] Connection header received
0807 22:37:40.440020 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:40.440023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:40.440083 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:40.440212 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:40.441377 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.441920 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.443046 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.443286 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.443403 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:40.446088 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:40.446094 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:40.446101 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:40.446124 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:40.447540 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.448048 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.448053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.448055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.448199 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.448552 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.448556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.448558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.448811 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:40.448917 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:40.449417 (+ 500us) server_negotiation.cc:299] Negotiation successful
0807 22:37:40.449536 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:37:40.450840 27113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:40.437970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:38757 (local address 127.26.52.65:43753)
0807 22:37:40.438396 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:40.438441 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:40.439769 (+ 1328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:40.440389 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:40.440396 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:40.440745 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:40.441223 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:40.441236 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.442050 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.442056 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:40.442903 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:40.442922 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.443445 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.443449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:40.443628 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:40.444176 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:40.444191 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:40.445909 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:40.447664 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:40.447670 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:40.447684 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:40.447943 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:40.448299 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:40.448302 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:40.448304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:40.448451 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:40.448917 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:40.448923 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:40.449164 (+ 241us) client_negotiation.cc:769] Sending connection context
0807 22:37:40.449365 (+ 201us) client_negotiation.cc:240] Negotiation successful
0807 22:37:40.449686 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":108,"threads_started":1}
I20260807 22:37:40.452203 27109 heartbeater.cc:347] Connected to a master server at 127.26.52.126:38757
I20260807 22:37:40.452448 27109 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:40.452931 27109 heartbeater.cc:511] Master 127.26.52.126:38757 requested a full tablet report, sending...
I20260807 22:37:40.454892 26890 ts_manager.cc:194] Registered new tserver with Master: be2159a5c89349c4b3cf8d4fc8d91419 (127.26.52.65:33983)
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:37:40.456632 26890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:43753
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:37:40.475870 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38757
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:40.591642 27117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:40.591966 27117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:40.592048 27117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:40.596041 27117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:40.596105 27117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:40.596241 27117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:37:40.601552 27117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:40.602679 27117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:40.603746 27117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:40.613560 27122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:40.613549 27125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:40.613596 27123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:40.613752 27117 server_base.cc:1034] running on GCE node
I20260807 22:37:40.614261 27117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:40.614847 27117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:40.616010 27117 hybrid_clock.cc:648] HybridClock initialized: now 1786142260615999 us; error 25 us; skew 500 ppm
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:40.618590 27117 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:37:40.619473 27117 webserver.cc:460] Webserver started at http://127.26.52.66:38115/ using document root <none> and password file <none>
I20260807 22:37:40.620049 27117 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:40.620183 27117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:40.620415 27117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:40.622485 27117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "3577ce7f79814b288fdcfb7bce2e1bd1"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "0f8f365f6a3f2e706865bf3e95386602"
server_key_iv: "e047671e7984feb6f95f56db13e41a8e"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.623091 27117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "3577ce7f79814b288fdcfb7bce2e1bd1"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "0f8f365f6a3f2e706865bf3e95386602"
server_key_iv: "e047671e7984feb6f95f56db13e41a8e"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.626752 27117 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:37:40.629150 27133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:40.630298 27117 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:40.630430 27117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "3577ce7f79814b288fdcfb7bce2e1bd1"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "0f8f365f6a3f2e706865bf3e95386602"
server_key_iv: "e047671e7984feb6f95f56db13e41a8e"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.630543 27117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:40.650067 27117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:40.653296 27117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:40.653506 27117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:40.654096 27117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:40.654945 27117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:40.655028 27117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:40.655121 27117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:40.655174 27117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:40.664445 27117 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:40239
I20260807 22:37:40.664503 27263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:40239 every 8 connection(s)
I20260807 22:37:40.665459 27117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:37:40.673270 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 27117
I20260807 22:37:40.673399 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:37:40.673741 26833 external_mini_cluster.cc:1428] Setting key 25a51c754015045a424f9514bf124c28
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:40.679373 26931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:40.667276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:47959 (local address 127.26.52.126:38757)
0807 22:37:40.667430 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:40.667436 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:40.668360 (+ 924us) server_negotiation.cc:407] Connection header received
0807 22:37:40.669606 (+ 1246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:40.669609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:40.669655 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:40.669730 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:40.670821 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.671352 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.672526 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.672731 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.672811 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:40.675686 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:40.675689 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:40.675691 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:40.675714 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:40.677136 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.677719 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.677726 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.677730 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.677828 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.678150 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.678154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.678158 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.678412 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:40.678521 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:40.678991 (+ 470us) server_negotiation.cc:299] Negotiation successful
0807 22:37:40.679130 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:37:40.680048 27266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:40.667711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:38757 (local address 127.26.52.66:47959)
0807 22:37:40.668203 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:40.668260 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:40.669410 (+ 1150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:40.669882 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:40.669888 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:40.670232 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:40.670700 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:40.670713 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.671467 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.671469 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:40.672421 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:40.672430 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.672857 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.672859 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:40.672994 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:40.673684 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:40.673705 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:40.675516 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:40.677287 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:40.677297 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:40.677316 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:40.677617 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:40.677925 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:40.677928 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:40.677930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:40.678058 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:40.678515 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:40.678519 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:40.678739 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 22:37:40.678894 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 22:37:40.679144 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":118,"threads_started":1}
I20260807 22:37:40.681411 27264 heartbeater.cc:347] Connected to a master server at 127.26.52.126:38757
I20260807 22:37:40.681663 27264 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:40.682163 27264 heartbeater.cc:511] Master 127.26.52.126:38757 requested a full tablet report, sending...
I20260807 22:37:40.683323 26890 ts_manager.cc:194] Registered new tserver with Master: 3577ce7f79814b288fdcfb7bce2e1bd1 (127.26.52.66:40239)
I20260807 22:37:40.684273 26890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:47959
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:37:40.701617 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38757
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:40.838536 27270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:40.838825 27270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:40.838909 27270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:40.842909 27270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:40.842993 27270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:40.843084 27270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:37:40.848486 27270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:40.849515 27270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:40.850584 27270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:40.860486 27275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:40.860527 27278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:40.860563 27276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:40.860795 27270 server_base.cc:1034] running on GCE node
I20260807 22:37:40.861182 27270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:40.861774 27270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:40.862941 27270 hybrid_clock.cc:648] HybridClock initialized: now 1786142260862910 us; error 43 us; skew 500 ppm
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:40.865758 27270 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:37:40.866601 27270 webserver.cc:460] Webserver started at http://127.26.52.67:44115/ using document root <none> and password file <none>
I20260807 22:37:40.867115 27270 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:40.867174 27270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:40.867336 27270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:40.869414 27270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "c5d4b88f00034a589ff771b475e05db4"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "ca941355b587d3074150788c5ee14014"
server_key_iv: "e09df88b5d97a58144596a5d5e301ea5"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.869925 27270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "c5d4b88f00034a589ff771b475e05db4"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "ca941355b587d3074150788c5ee14014"
server_key_iv: "e09df88b5d97a58144596a5d5e301ea5"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.873703 27270 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:37:40.875926 27287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:40.877127 27270 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:40.877260 27270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "c5d4b88f00034a589ff771b475e05db4"
format_stamp: "Formatted at 2026-08-07 22:37:40 on dist-test-slave-8w9v"
server_key: "ca941355b587d3074150788c5ee14014"
server_key_iv: "e09df88b5d97a58144596a5d5e301ea5"
server_key_version: "encryptionkey@0"
I20260807 22:37:40.877367 27270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:40.908995 27270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:40.912469 27270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:40.912678 27270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:40.913304 27270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:40.914152 27270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:40.914201 27270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:40.914279 27270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:40.914316 27270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:40.925280 27270 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:46607
I20260807 22:37:40.925302 27414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:46607 every 8 connection(s)
I20260807 22:37:40.926152 27270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:37:40.928632 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 27270
I20260807 22:37:40.928798 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:37:40.929138 26833 external_mini_cluster.cc:1428] Setting key e0be397f9fadf92d6b7a52a674cb6a3e
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:40.939579 26931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:40.928039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:42699 (local address 127.26.52.126:38757)
0807 22:37:40.928239 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:40.928244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:40.929111 (+ 867us) server_negotiation.cc:407] Connection header received
0807 22:37:40.930636 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:40.930639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:40.930706 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:40.930777 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:40.932073 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.932635 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.933749 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.934000 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.934077 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:40.936657 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:40.936660 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:40.936662 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:40.936691 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:40.937890 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.938363 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.938365 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.938367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.938437 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.938722 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.938724 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.938725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.938877 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:40.938957 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:40.939367 (+ 410us) server_negotiation.cc:299] Negotiation successful
0807 22:37:40.939461 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 22:37:40.940407 27420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:40.928447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:38757 (local address 127.26.52.67:42699)
0807 22:37:40.928932 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:40.928991 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:40.930387 (+ 1396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:40.930976 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:40.930982 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:40.931326 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:40.931922 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:40.931941 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.932741 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.932743 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:40.933613 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:40.933622 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.934127 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.934130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:40.934284 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:40.934929 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:40.934957 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:40.936469 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:40.938021 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:40.938026 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:40.938036 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:40.938275 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:40.938517 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:40.938519 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:40.938520 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:40.938644 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:40.938973 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:40.938977 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:40.939178 (+ 201us) client_negotiation.cc:769] Sending connection context
0807 22:37:40.939322 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 22:37:40.939550 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":105,"threads_started":1}
I20260807 22:37:40.941425 27416 heartbeater.cc:347] Connected to a master server at 127.26.52.126:38757
I20260807 22:37:40.941660 27416 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:40.942126 27416 heartbeater.cc:511] Master 127.26.52.126:38757 requested a full tablet report, sending...
I20260807 22:37:40.943130 26890 ts_manager.cc:194] Registered new tserver with Master: c5d4b88f00034a589ff771b475e05db4 (127.26.52.67:46607)
I20260807 22:37:40.943602 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:37:40.943718 26890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:42699
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:37:40.970367 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:40.961403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48594 (local address 127.26.52.65:33983)
0807 22:37:40.961742 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:40.961748 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:40.961774 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:37:40.961848 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:40.961853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:40.962037 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:40.962156 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:40.962815 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.963565 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.964426 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.964788 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.964872 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:40.967237 (+ 2365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:40.967246 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:40.967260 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:40.967281 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:40.968785 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.969164 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.969169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.969170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.969243 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.969466 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.969468 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.969469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.969687 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:40.969835 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:40.970020 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 22:37:40.970175 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":120,"threads_started":1}
W20260807 22:37:40.971372 27004 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48594
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:37:40 dist-test-slave-8w9v krb5kdc[26841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:37:40.999439 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:40.991001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48608 (local address 127.26.52.65:33983)
0807 22:37:40.991179 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:40.991184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:40.991319 (+ 135us) server_negotiation.cc:407] Connection header received
0807 22:37:40.991494 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:40.991498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:40.991555 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:40.991646 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:40.992387 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.992902 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.993739 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:40.993970 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:40.994080 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:40.996494 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:40.996499 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:40.996503 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:40.996532 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:40.997789 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.998208 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.998212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.998214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.998294 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:40.998573 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:40.998577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:40.998579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:40.998744 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:40.998880 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:40.999140 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 22:37:40.999265 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 22:37:41.000625 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 26955
I20260807 22:37:41.009178 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 27117
I20260807 22:37:41.016780 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 27270
I20260807 22:37:41.026782 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 26856
2026-08-07T22:37:41Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2360 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:37:41 dist-test-slave-8w9v krb5kdc[27433](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:37:41 dist-test-slave-8w9v krb5kdc[27433](info): set up 2 sockets
Aug 07 22:37:41 dist-test-slave-8w9v krb5kdc[27433](info): commencing operation
krb5kdc: starting...
W20260807 22:37:42.119693 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:37:42 dist-test-slave-8w9v krb5kdc[27433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:37:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:37:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:37:42.242712 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:41093
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:44055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:41093
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:42.358112 27447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:42.358374 27447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:42.358417 27447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:42.362469 27447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:37:42.362528 27447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:42.362551 27447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:42.362571 27447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:37:42.362599 27447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:37:42.367669 27447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:41093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:41093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:42.368727 27447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:42.369769 27447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:42.379012 27457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:42.379076 27455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:42.379166 27447 server_base.cc:1034] running on GCE node
W20260807 22:37:42.379020 27454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:42.379969 27447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:42.381124 27447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:42.382306 27447 hybrid_clock.cc:648] HybridClock initialized: now 1786142262382272 us; error 46 us; skew 500 ppm
Aug 07 22:37:42 dist-test-slave-8w9v krb5kdc[27433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142262, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:42.385334 27447 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:37:42.386250 27447 webserver.cc:460] Webserver started at http://127.26.52.126:44973/ using document root <none> and password file <none>
I20260807 22:37:42.386791 27447 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:42.386857 27447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:42.387032 27447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:42.389149 27447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "686d6bd114424481805f6d34822cd093"
format_stamp: "Formatted at 2026-08-07 22:37:42 on dist-test-slave-8w9v"
server_key: "687eaf9c294782b450f7799a1e43ab67"
server_key_iv: "b9d7833d68c037a0de5d814ed97c33ab"
server_key_version: "encryptionkey@0"
I20260807 22:37:42.389717 27447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "686d6bd114424481805f6d34822cd093"
format_stamp: "Formatted at 2026-08-07 22:37:42 on dist-test-slave-8w9v"
server_key: "687eaf9c294782b450f7799a1e43ab67"
server_key_iv: "b9d7833d68c037a0de5d814ed97c33ab"
server_key_version: "encryptionkey@0"
I20260807 22:37:42.393514 27447 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:37:42.395952 27465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:42.397186 27447 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:42.397287 27447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "686d6bd114424481805f6d34822cd093"
format_stamp: "Formatted at 2026-08-07 22:37:42 on dist-test-slave-8w9v"
server_key: "687eaf9c294782b450f7799a1e43ab67"
server_key_iv: "b9d7833d68c037a0de5d814ed97c33ab"
server_key_version: "encryptionkey@0"
I20260807 22:37:42.397372 27447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:42.409860 27447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:42.413128 27447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:42.413285 27447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:42.420701 27447 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:41093
I20260807 22:37:42.420710 27521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:41093 every 8 connection(s)
I20260807 22:37:42.421663 27447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:37:42.424388 27522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:42.428880 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 27447
I20260807 22:37:42.428982 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:37:42.429235 26833 external_mini_cluster.cc:1428] Setting key 425485b6036da89e7add53b03469814d
I20260807 22:37:42.430158 27522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093: Bootstrap starting.
I20260807 22:37:42.432785 27522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:42.433857 27522 log.cc:824] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:42.436064 27522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093: No bootstrap required, opened a new log
Aug 07 22:37:42 dist-test-slave-8w9v krb5kdc[27433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:42.441171 27522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686d6bd114424481805f6d34822cd093" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41093 } }
I20260807 22:37:42.441426 27522 raft_consensus.cc:374] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:42.441511 27522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 686d6bd114424481805f6d34822cd093, State: Initialized, Role: FOLLOWER
I20260807 22:37:42.441975 27522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686d6bd114424481805f6d34822cd093" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41093 } }
I20260807 22:37:42.442131 27522 raft_consensus.cc:388] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:37:42.442227 27522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:37:42.442350 27522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:42.443424 27522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686d6bd114424481805f6d34822cd093" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41093 } }
I20260807 22:37:42.443811 27522 leader_election.cc:302] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 686d6bd114424481805f6d34822cd093; no voters:
I20260807 22:37:42.444164 27522 leader_election.cc:288] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:37:42.444255 27527 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:42.444504 27527 raft_consensus.cc:686] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [term 1 LEADER]: Becoming Leader. State: Replica: 686d6bd114424481805f6d34822cd093, State: Running, Role: LEADER
I20260807 22:37:42.444810 27527 consensus_queue.cc:237] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686d6bd114424481805f6d34822cd093" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41093 } }
I20260807 22:37:42.444944 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:42.430809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55796 (local address 127.26.52.126:41093)
0807 22:37:42.431242 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:42.431259 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:42.431294 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:37:42.432027 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:42.432046 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:42.432485 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:42.432761 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:42.433747 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:42.435071 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:42.436275 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:42.436730 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:42.436853 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:42.439731 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:42.439736 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:42.439749 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:42.439776 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:42.441531 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:42.442078 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:42.442087 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:42.442096 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:42.442290 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:42.442618 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:42.442620 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:42.442622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:42.443013 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:42.443170 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:42.443481 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 22:37:42.443827 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":140,"threads_started":1}
I20260807 22:37:42.445533 27522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:37:42.446031 27527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 686d6bd114424481805f6d34822cd093. Latest consensus state: current_term: 1 leader_uuid: "686d6bd114424481805f6d34822cd093" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686d6bd114424481805f6d34822cd093" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41093 } } }
I20260807 22:37:42.446146 27527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:42.446465 27528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "686d6bd114424481805f6d34822cd093" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "686d6bd114424481805f6d34822cd093" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41093 } } }
I20260807 22:37:42.446576 27528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093 [sys.catalog]: This master's current role is: LEADER
W20260807 22:37:42.450290 27543 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:37:42.450379 27543 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:37:42.450450 27531 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:37:42.451161 27531 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:37:42.456282 27531 catalog_manager.cc:1347] Generated new cluster ID: 1c5fdd224e7b451a84f449df9c54b529
I20260807 22:37:42.456408 27531 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:37:42.469586 27531 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:37:42.470496 27531 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:37:42.475464 27531 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 686d6bd114424481805f6d34822cd093: Generated new TSK 0
I20260807 22:37:42.476111 27531 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:37:42.507619 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41093
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:44055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:42.619029 27549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:42.619266 27549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:42.619309 27549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:42.623225 27549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:42.623276 27549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:42.623333 27549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:37:42.628382 27549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41093
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:42.629287 27549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:42.630198 27549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:42.639405 27556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:42.639619 27549 server_base.cc:1034] running on GCE node
W20260807 22:37:42.639377 27559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:42.639389 27557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:42.640201 27549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:42.640802 27549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:42.641989 27549 hybrid_clock.cc:648] HybridClock initialized: now 1786142262641976 us; error 24 us; skew 500 ppm
Aug 07 22:37:42 dist-test-slave-8w9v krb5kdc[27433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142262, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:42.644701 27549 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:37:42.645503 27549 webserver.cc:460] Webserver started at http://127.26.52.65:36053/ using document root <none> and password file <none>
I20260807 22:37:42.646127 27549 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:42.646215 27549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:42.646441 27549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:42.648617 27549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "032c7326c68d4b138e54e7b2ef7ef04d"
format_stamp: "Formatted at 2026-08-07 22:37:42 on dist-test-slave-8w9v"
server_key: "15a11ddd6720cacddbb149c139733bb2"
server_key_iv: "baec027b9edc109f7be3915db5a7b935"
server_key_version: "encryptionkey@0"
I20260807 22:37:42.649168 27549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "032c7326c68d4b138e54e7b2ef7ef04d"
format_stamp: "Formatted at 2026-08-07 22:37:42 on dist-test-slave-8w9v"
server_key: "15a11ddd6720cacddbb149c139733bb2"
server_key_iv: "baec027b9edc109f7be3915db5a7b935"
server_key_version: "encryptionkey@0"
I20260807 22:37:42.652683 27549 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:37:42.654912 27568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:42.656069 27549 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:42.656225 27549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "032c7326c68d4b138e54e7b2ef7ef04d"
format_stamp: "Formatted at 2026-08-07 22:37:42 on dist-test-slave-8w9v"
server_key: "15a11ddd6720cacddbb149c139733bb2"
server_key_iv: "baec027b9edc109f7be3915db5a7b935"
server_key_version: "encryptionkey@0"
I20260807 22:37:42.656334 27549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:42.668493 27549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:42.671551 27549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:42.671746 27549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:42.672329 27549 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:42.673120 27549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:42.673189 27549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:42.673260 27549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:42.673305 27549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:42.681661 27549 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:39985
I20260807 22:37:42.681726 27688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:39985 every 8 connection(s)
I20260807 22:37:42.682528 27549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:37:42.684048 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 27549
I20260807 22:37:42.684186 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:37:42.684478 26833 external_mini_cluster.cc:1428] Setting key 3f8b37f74d0ae0e7f19b63eb13591198
Aug 07 22:37:42 dist-test-slave-8w9v krb5kdc[27433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142262, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:37:42.696059 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:42.684929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:43953 (local address 127.26.52.126:41093)
0807 22:37:42.685100 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:42.685108 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:42.685496 (+ 388us) server_negotiation.cc:407] Connection header received
0807 22:37:42.686540 (+ 1044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:42.686545 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:42.686607 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:42.686696 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:42.687771 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:42.688380 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:42.689487 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:42.689732 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:42.689843 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:42.692655 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:42.692658 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:42.692660 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:42.692683 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:42.694133 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:42.694722 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:42.694725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:42.694726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:42.694801 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:42.695121 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:42.695123 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:42.695124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:42.695285 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:42.695361 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:42.695824 (+ 463us) server_negotiation.cc:299] Negotiation successful
0807 22:37:42.695921 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:37:42.697059 27691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:42.684806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41093 (local address 127.26.52.65:43953)
0807 22:37:42.685356 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:42.685407 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:42.686333 (+ 926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:42.686838 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:42.686845 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:42.687171 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:42.687601 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:42.687612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:42.688510 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:42.688514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:42.689357 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:42.689366 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:42.689881 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:42.689885 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:42.690058 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:42.690630 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:42.690645 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:42.692481 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:42.694283 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:42.694290 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:42.694305 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:42.694634 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:42.694883 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:42.694885 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:42.694887 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:42.695023 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:42.695392 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:42.695398 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:42.695622 (+ 224us) client_negotiation.cc:769] Sending connection context
0807 22:37:42.695777 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 22:37:42.696021 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":136,"threads_started":1}
I20260807 22:37:42.698365 27689 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41093
I20260807 22:37:42.698597 27689 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:42.699067 27689 heartbeater.cc:511] Master 127.26.52.126:41093 requested a full tablet report, sending...
I20260807 22:37:42.700598 27483 ts_manager.cc:194] Registered new tserver with Master: 032c7326c68d4b138e54e7b2ef7ef04d (127.26.52.65:39985)
I20260807 22:37:42.701833 27483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:43953
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:37:42.710968 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41093
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:44055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:42.823166 27694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:42.823415 27694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:42.823490 27694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:42.827544 27694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:42.827596 27694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:42.827705 27694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:37:42.832650 27694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41093
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:42.833585 27694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:42.834584 27694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:42.843973 27707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:42.844020 27701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:42.844069 27694 server_base.cc:1034] running on GCE node
W20260807 22:37:42.843995 27700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:42.844547 27694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:42.845162 27694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:42.846345 27694 hybrid_clock.cc:648] HybridClock initialized: now 1786142262846310 us; error 41 us; skew 500 ppm
Aug 07 22:37:42 dist-test-slave-8w9v krb5kdc[27433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142262, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:42.849115 27694 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:37:42.849929 27694 webserver.cc:460] Webserver started at http://127.26.52.66:33345/ using document root <none> and password file <none>
I20260807 22:37:42.850407 27694 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:42.850464 27694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:42.850682 27694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:42.852671 27694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "c7c5761051104f198cc61f049aa54050"
format_stamp: "Formatted at 2026-08-07 22:37:42 on dist-test-slave-8w9v"
server_key: "b7c525cb532e556a52ea0a8187956013"
server_key_iv: "749c615499fd367d9fee875faef2ac00"
server_key_version: "encryptionkey@0"
I20260807 22:37:42.853165 27694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "c7c5761051104f198cc61f049aa54050"
format_stamp: "Formatted at 2026-08-07 22:37:42 on dist-test-slave-8w9v"
server_key: "b7c525cb532e556a52ea0a8187956013"
server_key_iv: "749c615499fd367d9fee875faef2ac00"
server_key_version: "encryptionkey@0"
I20260807 22:37:42.856685 27694 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:37:42.859028 27714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:42.860344 27694 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:42.860438 27694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "c7c5761051104f198cc61f049aa54050"
format_stamp: "Formatted at 2026-08-07 22:37:42 on dist-test-slave-8w9v"
server_key: "b7c525cb532e556a52ea0a8187956013"
server_key_iv: "749c615499fd367d9fee875faef2ac00"
server_key_version: "encryptionkey@0"
I20260807 22:37:42.860549 27694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:42.877082 27694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:42.879912 27694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:42.880076 27694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:42.880649 27694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:42.881440 27694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:42.881515 27694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:42.881580 27694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:42.881609 27694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:42.890147 27694 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:34793
I20260807 22:37:42.890216 27833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:34793 every 8 connection(s)
I20260807 22:37:42.891052 27694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:37:42.896967 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 27694
I20260807 22:37:42.897075 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:37:42.897392 26833 external_mini_cluster.cc:1428] Setting key 9def0fe179047f4078c020abadbf4a39
Aug 07 22:37:42 dist-test-slave-8w9v krb5kdc[27433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142262, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:42.904572 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:42.892813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:52543 (local address 127.26.52.126:41093)
0807 22:37:42.892967 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:42.892971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:42.893729 (+ 758us) server_negotiation.cc:407] Connection header received
0807 22:37:42.894630 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:42.894633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:42.894699 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:42.894803 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:42.896053 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:42.896657 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:42.898055 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:42.898314 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:42.898422 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:42.901122 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:42.901126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:42.901129 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:42.901158 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:42.902512 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:42.903025 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:42.903029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:42.903031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:42.903111 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:42.903469 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:42.903473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:42.903475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:42.903659 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:42.903765 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:42.904285 (+ 520us) server_negotiation.cc:299] Negotiation successful
0807 22:37:42.904406 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 22:37:42.905396 27836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:42.893098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41093 (local address 127.26.52.66:52543)
0807 22:37:42.893577 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:42.893618 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:42.894419 (+ 801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:42.894975 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:42.894982 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:42.895360 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:42.895876 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:42.895890 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:42.896799 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:42.896802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:42.897925 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:42.897938 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:42.898502 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:42.898505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:42.898695 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:42.899380 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:42.899397 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:42.900961 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:42.902638 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:42.902644 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:42.902659 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:42.902917 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:42.903203 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:42.903207 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:42.903209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:42.903352 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:42.903764 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:42.903773 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:42.904023 (+ 250us) client_negotiation.cc:769] Sending connection context
0807 22:37:42.904241 (+ 218us) client_negotiation.cc:240] Negotiation successful
0807 22:37:42.904571 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":146,"threads_started":1}
I20260807 22:37:42.906567 27834 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41093
I20260807 22:37:42.906808 27834 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:42.907292 27834 heartbeater.cc:511] Master 127.26.52.126:41093 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:37:42.908397 27483 ts_manager.cc:194] Registered new tserver with Master: c7c5761051104f198cc61f049aa54050 (127.26.52.66:34793)
I20260807 22:37:42.908936 27483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:52543
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:37:42.926512 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41093
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:44055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:43.037041 27839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:43.037330 27839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:43.037407 27839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:43.041651 27839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:43.041734 27839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:43.041821 27839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:37:43.047206 27839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41093
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:43.048296 27839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:43.049283 27839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:43.058929 27845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:43.058971 27839 server_base.cc:1034] running on GCE node
W20260807 22:37:43.059005 27847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:43.059150 27844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:43.059854 27839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:43.060597 27839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:43.061771 27839 hybrid_clock.cc:648] HybridClock initialized: now 1786142263061750 us; error 34 us; skew 500 ppm
Aug 07 22:37:43 dist-test-slave-8w9v krb5kdc[27433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142263, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:43.064945 27839 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:37:43.065817 27839 webserver.cc:460] Webserver started at http://127.26.52.67:35043/ using document root <none> and password file <none>
I20260807 22:37:43.066380 27839 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:43.066453 27839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:43.066690 27839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:43.068784 27839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "fd410d9b1b0d4115a32a34ebeb25069a"
format_stamp: "Formatted at 2026-08-07 22:37:43 on dist-test-slave-8w9v"
server_key: "504c72b3088080321c4376f3de951a73"
server_key_iv: "75dc30915060f72a7e8bc97a6f68e8b9"
server_key_version: "encryptionkey@0"
I20260807 22:37:43.069360 27839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "fd410d9b1b0d4115a32a34ebeb25069a"
format_stamp: "Formatted at 2026-08-07 22:37:43 on dist-test-slave-8w9v"
server_key: "504c72b3088080321c4376f3de951a73"
server_key_iv: "75dc30915060f72a7e8bc97a6f68e8b9"
server_key_version: "encryptionkey@0"
I20260807 22:37:43.073014 27839 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:37:43.075340 27855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:43.076579 27839 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:37:43.076719 27839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "fd410d9b1b0d4115a32a34ebeb25069a"
format_stamp: "Formatted at 2026-08-07 22:37:43 on dist-test-slave-8w9v"
server_key: "504c72b3088080321c4376f3de951a73"
server_key_iv: "75dc30915060f72a7e8bc97a6f68e8b9"
server_key_version: "encryptionkey@0"
I20260807 22:37:43.076830 27839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:43.088363 27839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:43.091527 27839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:43.091727 27839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:43.092370 27839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:43.093168 27839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:43.093236 27839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:43.093308 27839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:43.093356 27839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:43.102530 27839 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:42679
I20260807 22:37:43.102591 27979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:42679 every 8 connection(s)
I20260807 22:37:43.103452 27839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:37:43.112425 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 27839
I20260807 22:37:43.112540 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:37:43.112843 26833 external_mini_cluster.cc:1428] Setting key 7a66589922aaaa1836695cd9f4bf3059
Aug 07 22:37:43 dist-test-slave-8w9v krb5kdc[27433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142263, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:43.117209 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.105352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:58185 (local address 127.26.52.126:41093)
0807 22:37:43.105515 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:43.105519 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:43.106341 (+ 822us) server_negotiation.cc:407] Connection header received
0807 22:37:43.107317 (+ 976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:43.107321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:43.107387 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:43.107501 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:43.108739 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.109342 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.110581 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.110830 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.110949 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.113604 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:43.113608 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:43.113611 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:43.113640 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:43.115411 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:43.115863 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:43.115865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:43.115867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:43.115942 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:43.116301 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:43.116303 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:43.116304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:43.116475 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:43.116558 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:43.116988 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 22:37:43.117085 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 22:37:43.117988 27982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.105696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41093 (local address 127.26.52.67:58185)
0807 22:37:43.106147 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:43.106191 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:43.107080 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:43.107684 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:43.107691 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:43.108072 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:43.108573 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.108587 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.109483 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.109489 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.110433 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.110444 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.110991 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.110996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.111178 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.111697 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:43.111714 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:43.113424 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:43.115522 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:43.115526 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:43.115536 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:43.115775 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:43.116039 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:43.116041 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:43.116042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:43.116231 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:43.116564 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:43.116570 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:43.116776 (+ 206us) client_negotiation.cc:769] Sending connection context
0807 22:37:43.116916 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 22:37:43.117144 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":105,"threads_started":1}
I20260807 22:37:43.119177 27980 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41093
I20260807 22:37:43.119408 27980 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:43.119869 27980 heartbeater.cc:511] Master 127.26.52.126:41093 requested a full tablet report, sending...
I20260807 22:37:43.120954 27483 ts_manager.cc:194] Registered new tserver with Master: fd410d9b1b0d4115a32a34ebeb25069a (127.26.52.67:42679)
I20260807 22:37:43.121541 27483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:58185
I20260807 22:37:43.126948 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:37:43.138262 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.130871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55812 (local address 127.26.52.126:41093)
0807 22:37:43.131036 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:43.131040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:43.131198 (+ 158us) server_negotiation.cc:407] Connection header received
0807 22:37:43.131388 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:43.131398 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:43.131439 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:43.131523 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:43.132317 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.132823 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.133666 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.133891 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.134005 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.135296 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:43.135302 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:43.135306 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:43.135331 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:43.136566 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:43.136997 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:43.137000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:43.137002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:43.137086 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:43.137374 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:43.137378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:43.137379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:43.137592 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:43.137741 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:43.137981 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 22:37:43.138101 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 22:37:43.143726 27483 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55812:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:37:43.146944 27483 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:37:43.162323 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.156504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:34793 (local address 127.0.0.1:46164)
0807 22:37:43.157401 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:43.157415 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:43.157500 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:43.158316 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:43.158319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:43.158335 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:43.158415 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.158421 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.159843 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.159845 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.160739 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.160752 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.161771 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.161775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.161900 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.161941 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 22:37:43.162053 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 22:37:43.162170 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"mutex_wait_us":2,"thread_start_us":96,"threads_started":1}
I20260807 22:37:43.162329 27995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.157203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46164 (local address 127.26.52.66:34793)
0807 22:37:43.157725 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:43.157737 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:43.157760 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:37:43.157834 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:43.157839 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:43.158027 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:43.158182 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:43.158557 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.159694 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.160888 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.161644 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.161770 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.161978 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:43.162078 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 22:37:43.162170 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":154,"threads_started":1}
I20260807 22:37:43.162549 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.156063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:42679 (local address 127.0.0.1:50498)
0807 22:37:43.156432 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:43.156481 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:43.156833 (+ 352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:43.157667 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:43.157672 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:43.157693 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:43.157836 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.157843 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.159101 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.159106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.160622 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.160633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.162049 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.162054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.162191 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.162215 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:37:43.162298 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 22:37:43.162375 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":29,"thread_start_us":89,"threads_started":1}
I20260807 22:37:43.163091 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.156273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:39985 (local address 127.0.0.1:32884)
0807 22:37:43.156743 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:43.156757 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:43.156843 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:43.158145 (+ 1302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:43.158149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:43.158166 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:43.158259 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.158265 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.159780 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.159787 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.161008 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.161017 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.162070 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.162074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.162798 (+ 724us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.162826 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 22:37:43.162901 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 22:37:43.162968 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":619,"thread_start_us":83,"threads_started":1}
I20260807 22:37:43.163335 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.157311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32884 (local address 127.26.52.65:39985)
0807 22:37:43.157690 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:43.157706 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:43.157727 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:37:43.157801 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:43.157805 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:43.158000 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:43.158146 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:43.158379 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.159575 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.161130 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.161940 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.162192 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.162330 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:43.162942 (+ 612us) server_negotiation.cc:299] Negotiation successful
0807 22:37:43.163034 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":90,"threads_started":1}
I20260807 22:37:43.163664 27994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.156740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50498 (local address 127.26.52.67:42679)
0807 22:37:43.157123 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:43.157137 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:43.157159 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:37:43.157235 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:43.157241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:43.157461 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:43.157659 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:43.157958 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.158976 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.160861 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.161710 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.161829 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.161978 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:43.163315 (+ 1337us) server_negotiation.cc:299] Negotiation successful
0807 22:37:43.163428 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":172,"threads_started":1}
I20260807 22:37:43.165712 27765 tablet_service.cc:1467] Processing CreateTablet for tablet afb14918acf644119f8d6da638217480 (DEFAULT_TABLE table=test-table [id=67da47db46804818904eeb0fa6a5d4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:43.166321 27620 tablet_service.cc:1467] Processing CreateTablet for tablet afb14918acf644119f8d6da638217480 (DEFAULT_TABLE table=test-table [id=67da47db46804818904eeb0fa6a5d4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:43.166327 27907 tablet_service.cc:1467] Processing CreateTablet for tablet afb14918acf644119f8d6da638217480 (DEFAULT_TABLE table=test-table [id=67da47db46804818904eeb0fa6a5d4e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:43.167018 27765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afb14918acf644119f8d6da638217480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:43.167313 27907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afb14918acf644119f8d6da638217480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:43.167313 27620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afb14918acf644119f8d6da638217480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:43.173316 27997 tablet_bootstrap.cc:492] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050: Bootstrap starting.
I20260807 22:37:43.174670 27999 tablet_bootstrap.cc:492] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a: Bootstrap starting.
I20260807 22:37:43.175009 27998 tablet_bootstrap.cc:492] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d: Bootstrap starting.
I20260807 22:37:43.176506 27997 tablet_bootstrap.cc:654] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:43.177371 27998 tablet_bootstrap.cc:654] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:43.177459 27999 tablet_bootstrap.cc:654] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:43.178321 27997 log.cc:824] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:43.179065 27998 log.cc:824] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:43.179445 27999 log.cc:824] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:43.180794 27997 tablet_bootstrap.cc:492] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050: No bootstrap required, opened a new log
I20260807 22:37:43.180991 27997 ts_tablet_manager.cc:1397] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 22:37:43.181569 27998 tablet_bootstrap.cc:492] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d: No bootstrap required, opened a new log
I20260807 22:37:43.181771 27998 ts_tablet_manager.cc:1397] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:37:43.181793 27999 tablet_bootstrap.cc:492] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a: No bootstrap required, opened a new log
I20260807 22:37:43.181962 27999 ts_tablet_manager.cc:1397] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:37:43.186372 27998 raft_consensus.cc:348] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 42679 } } peers { permanent_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39985 } } peers { permanent_uuid: "c7c5761051104f198cc61f049aa54050" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34793 } }
I20260807 22:37:43.186604 27998 raft_consensus.cc:374] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:43.186658 27998 raft_consensus.cc:729] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 032c7326c68d4b138e54e7b2ef7ef04d, State: Initialized, Role: FOLLOWER
I20260807 22:37:43.187069 27998 consensus_queue.cc:260] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 42679 } } peers { permanent_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39985 } } peers { permanent_uuid: "c7c5761051104f198cc61f049aa54050" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34793 } }
I20260807 22:37:43.187834 27689 heartbeater.cc:503] Master 127.26.52.126:41093 was elected leader, sending a full tablet report...
I20260807 22:37:43.187668 27997 raft_consensus.cc:348] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 42679 } } peers { permanent_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39985 } } peers { permanent_uuid: "c7c5761051104f198cc61f049aa54050" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34793 } }
I20260807 22:37:43.188097 27997 raft_consensus.cc:374] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:43.188185 27998 ts_tablet_manager.cc:1428] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d: Time spent starting tablet: real 0.006s user 0.002s sys 0.006s
I20260807 22:37:43.188186 27997 raft_consensus.cc:729] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c5761051104f198cc61f049aa54050, State: Initialized, Role: FOLLOWER
I20260807 22:37:43.188638 27997 consensus_queue.cc:260] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 42679 } } peers { permanent_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39985 } } peers { permanent_uuid: "c7c5761051104f198cc61f049aa54050" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34793 } }
I20260807 22:37:43.188547 27999 raft_consensus.cc:348] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 42679 } } peers { permanent_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39985 } } peers { permanent_uuid: "c7c5761051104f198cc61f049aa54050" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34793 } }
I20260807 22:37:43.188889 27999 raft_consensus.cc:374] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:43.189009 27999 raft_consensus.cc:729] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd410d9b1b0d4115a32a34ebeb25069a, State: Initialized, Role: FOLLOWER
I20260807 22:37:43.189461 27999 consensus_queue.cc:260] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 42679 } } peers { permanent_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39985 } } peers { permanent_uuid: "c7c5761051104f198cc61f049aa54050" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34793 } }
I20260807 22:37:43.189554 27834 heartbeater.cc:503] Master 127.26.52.126:41093 was elected leader, sending a full tablet report...
I20260807 22:37:43.190276 27980 heartbeater.cc:503] Master 127.26.52.126:41093 was elected leader, sending a full tablet report...
I20260807 22:37:43.191649 27999 ts_tablet_manager.cc:1428] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a: Time spent starting tablet: real 0.010s user 0.005s sys 0.005s
I20260807 22:37:43.193907 27997 ts_tablet_manager.cc:1428] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050: Time spent starting tablet: real 0.013s user 0.004s sys 0.005s
W20260807 22:37:43.354593 27981 tablet.cc:2369] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:37:43.392316 27835 tablet.cc:2369] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:37:43.400870 28003 raft_consensus.cc:482] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:37:43.401098 28003 raft_consensus.cc:504] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 42679 } } peers { permanent_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39985 } } peers { permanent_uuid: "c7c5761051104f198cc61f049aa54050" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34793 } }
I20260807 22:37:43.402303 28003 leader_election.cc:288] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd410d9b1b0d4115a32a34ebeb25069a (127.26.52.67:42679), c7c5761051104f198cc61f049aa54050 (127.26.52.66:34793)
I20260807 22:37:43.406746 27994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.402761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:37837 (local address 127.26.52.67:42679)
0807 22:37:43.402903 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:43.402907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:43.403050 (+ 143us) server_negotiation.cc:407] Connection header received
0807 22:37:43.403242 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:43.403245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:43.403299 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:43.403383 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:43.403776 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.404411 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.405617 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.406177 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.406314 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.406383 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:43.406558 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 22:37:43.406625 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:37:43.406827 28006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.402564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:42679 (local address 127.26.52.65:37837)
0807 22:37:43.402948 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:43.402962 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:43.403101 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:43.403407 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:43.403410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:43.403436 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:43.403652 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.403659 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.404536 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.404541 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.405491 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.405500 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.406314 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.406318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.406418 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.406455 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 22:37:43.406539 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 22:37:43.406610 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"spinlock_wait_cycles":3328,"thread_start_us":104,"threads_started":1}
I20260807 22:37:43.407050 27995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.402775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:59359 (local address 127.26.52.66:34793)
0807 22:37:43.402964 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:43.402971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:43.403414 (+ 443us) server_negotiation.cc:407] Connection header received
0807 22:37:43.403591 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:43.403594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:43.403639 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:43.403735 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:43.404198 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.404671 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.405983 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.406360 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.406488 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.406537 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:43.406829 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 22:37:43.406932 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 22:37:43.407248 28007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.402573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:34793 (local address 127.26.52.65:59359)
0807 22:37:43.403271 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:43.403290 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:43.403463 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:43.403735 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:43.403738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:43.403754 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:43.404034 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.404041 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.404802 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.404806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.405836 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:43.405846 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.406486 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.406489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:43.406698 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.406717 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 22:37:43.406939 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 22:37:43.407010 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"mutex_wait_us":51,"thread_start_us":257,"threads_started":1}
I20260807 22:37:43.408047 27929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afb14918acf644119f8d6da638217480" candidate_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" is_pre_election: true
I20260807 22:37:43.408022 27785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afb14918acf644119f8d6da638217480" candidate_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c5761051104f198cc61f049aa54050" is_pre_election: true
I20260807 22:37:43.408489 27785 raft_consensus.cc:2454] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 032c7326c68d4b138e54e7b2ef7ef04d in term 0.
I20260807 22:37:43.409067 27572 leader_election.cc:302] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 032c7326c68d4b138e54e7b2ef7ef04d, c7c5761051104f198cc61f049aa54050; no voters:
I20260807 22:37:43.409371 28003 raft_consensus.cc:2781] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:37:43.409456 28003 raft_consensus.cc:482] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:37:43.409516 28003 raft_consensus.cc:3037] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:43.410970 28003 raft_consensus.cc:504] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 42679 } } peers { permanent_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39985 } } peers { permanent_uuid: "c7c5761051104f198cc61f049aa54050" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34793 } }
I20260807 22:37:43.411099 27929 raft_consensus.cc:2454] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 032c7326c68d4b138e54e7b2ef7ef04d in term 0.
I20260807 22:37:43.411368 28003 leader_election.cc:288] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [CANDIDATE]: Term 1 election: Requested vote from peers fd410d9b1b0d4115a32a34ebeb25069a (127.26.52.67:42679), c7c5761051104f198cc61f049aa54050 (127.26.52.66:34793)
I20260807 22:37:43.411804 27785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afb14918acf644119f8d6da638217480" candidate_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c5761051104f198cc61f049aa54050"
I20260807 22:37:43.411985 27928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afb14918acf644119f8d6da638217480" candidate_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd410d9b1b0d4115a32a34ebeb25069a"
I20260807 22:37:43.411998 27785 raft_consensus.cc:3037] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:43.412142 27928 raft_consensus.cc:3037] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:43.414181 27785 raft_consensus.cc:2454] T afb14918acf644119f8d6da638217480 P c7c5761051104f198cc61f049aa54050 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 032c7326c68d4b138e54e7b2ef7ef04d in term 1.
I20260807 22:37:43.414440 27928 raft_consensus.cc:2454] T afb14918acf644119f8d6da638217480 P fd410d9b1b0d4115a32a34ebeb25069a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 032c7326c68d4b138e54e7b2ef7ef04d in term 1.
I20260807 22:37:43.414510 27572 leader_election.cc:302] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 032c7326c68d4b138e54e7b2ef7ef04d, c7c5761051104f198cc61f049aa54050; no voters:
I20260807 22:37:43.414685 28003 raft_consensus.cc:2781] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:43.414923 28003 raft_consensus.cc:686] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [term 1 LEADER]: Becoming Leader. State: Replica: 032c7326c68d4b138e54e7b2ef7ef04d, State: Running, Role: LEADER
I20260807 22:37:43.415282 28003 consensus_queue.cc:237] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 42679 } } peers { permanent_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39985 } } peers { permanent_uuid: "c7c5761051104f198cc61f049aa54050" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34793 } }
I20260807 22:37:43.418951 27482 catalog_manager.cc:5495] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d reported cstate change: term changed from 0 to 1, leader changed from <none> to 032c7326c68d4b138e54e7b2ef7ef04d (127.26.52.65). New cstate: current_term: 1 leader_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd410d9b1b0d4115a32a34ebeb25069a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "032c7326c68d4b138e54e7b2ef7ef04d" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7c5761051104f198cc61f049aa54050" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34793 } health_report { overall_health: UNKNOWN } } }
W20260807 22:37:43.433909 27690 tablet.cc:2369] T afb14918acf644119f8d6da638217480 P 032c7326c68d4b138e54e7b2ef7ef04d: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 22:37:43 dist-test-slave-8w9v krb5kdc[27433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:37:43.455040 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.445594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42448 (local address 127.26.52.65:39985)
0807 22:37:43.445718 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:43.445722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:43.446108 (+ 386us) server_negotiation.cc:407] Connection header received
0807 22:37:43.446207 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:43.446210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:43.446298 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:43.446367 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:43.447219 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.447799 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.448809 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.449006 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.449080 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.451667 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:43.451676 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:43.451689 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:43.451709 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:43.453405 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:43.453854 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:43.453859 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:43.453861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:43.454027 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:43.454257 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:43.454259 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:43.454261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:43.454492 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:43.454640 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:43.454799 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 22:37:43.454889 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 07 22:37:43 dist-test-slave-8w9v krb5kdc[27433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142263, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:37:43 dist-test-slave-8w9v krb5kdc[27433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142263, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:37:43.484311 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.475084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42450 (local address 127.26.52.65:39985)
0807 22:37:43.475279 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:43.475284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:43.475445 (+ 161us) server_negotiation.cc:407] Connection header received
0807 22:37:43.475629 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:43.475637 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:43.475682 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:43.475772 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:43.476628 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.477279 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.478131 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.478436 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.478558 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.481474 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:43.481477 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:43.481479 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:43.481507 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:43.482749 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:43.483142 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:43.483145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:43.483146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:43.483219 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:43.483485 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:43.483489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:43.483490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:43.483663 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:43.483893 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:43.484008 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 22:37:43.484112 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 22:37:43 dist-test-slave-8w9v krb5kdc[27433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:37:43 dist-test-slave-8w9v krb5kdc[27433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:37:43.513500 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:43.504729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42456 (local address 127.26.52.65:39985)
0807 22:37:43.504915 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:43.504920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:43.505065 (+ 145us) server_negotiation.cc:407] Connection header received
0807 22:37:43.505236 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:43.505239 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:43.505314 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:43.505407 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:43.506112 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.506632 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.507563 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:43.507792 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:43.507903 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:43.510467 (+ 2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:43.510470 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:43.510473 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:43.510496 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:43.511759 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:43.512253 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:43.512259 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:43.512261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:43.512344 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:43.512629 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:43.512633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:43.512635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:43.512810 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:43.512953 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:43.513199 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 22:37:43.513323 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260807 22:37:43.515049 27598 tablet_service.cc:2908] Rejecting scan request for tablet afb14918acf644119f8d6da638217480: Uninitialized: clean time has not yet been initialized
I20260807 22:37:43.517433 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 27549
I20260807 22:37:43.526765 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 27694
I20260807 22:37:43.535115 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 27839
I20260807 22:37:43.542223 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 27447
2026-08-07T22:37:43Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2515 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:37:43 dist-test-slave-8w9v krb5kdc[28023](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:37:43 dist-test-slave-8w9v krb5kdc[28023](info): set up 2 sockets
Aug 07 22:37:43 dist-test-slave-8w9v krb5kdc[28023](info): commencing operation
krb5kdc: starting...
W20260807 22:37:44.605909 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:37:44 dist-test-slave-8w9v krb5kdc[28023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:37:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:37:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:37:44.725093 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:44771
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:35639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:44771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:44.835005 28039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:44.835244 28039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:44.835282 28039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:44.839301 28039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:37:44.839352 28039 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 22:37:44.839368 28039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:44.839387 28039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:44.839439 28039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:37:44.839471 28039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:37:44.844636 28039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:44771
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:44771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:44.845615 28039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:44.846611 28039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:44.855186 28044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:44.855319 28039 server_base.cc:1034] running on GCE node
W20260807 22:37:44.855266 28046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:44.855266 28048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:44.856021 28039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:44.857069 28039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:44.858256 28039 hybrid_clock.cc:648] HybridClock initialized: now 1786142264858231 us; error 38 us; skew 500 ppm
Aug 07 22:37:44 dist-test-slave-8w9v krb5kdc[28023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142264, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:44.866631 28039 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:37:44.867489 28039 webserver.cc:460] Webserver started at http://127.26.52.126:40793/ using document root <none> and password file <none>
I20260807 22:37:44.868007 28039 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:44.868064 28039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:44.868295 28039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:44.870268 28039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "790ce382a52a423ca02069c8397ecf22"
format_stamp: "Formatted at 2026-08-07 22:37:44 on dist-test-slave-8w9v"
server_key: "2fbe9431cfb3ffff17d7d5ebdb203b64"
server_key_iv: "11cfb48eac37ece29fb88018b44298cb"
server_key_version: "encryptionkey@0"
I20260807 22:37:44.870774 28039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "790ce382a52a423ca02069c8397ecf22"
format_stamp: "Formatted at 2026-08-07 22:37:44 on dist-test-slave-8w9v"
server_key: "2fbe9431cfb3ffff17d7d5ebdb203b64"
server_key_iv: "11cfb48eac37ece29fb88018b44298cb"
server_key_version: "encryptionkey@0"
I20260807 22:37:44.874390 28039 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:37:44.876756 28055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:44.877960 28039 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:44.878062 28039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "790ce382a52a423ca02069c8397ecf22"
format_stamp: "Formatted at 2026-08-07 22:37:44 on dist-test-slave-8w9v"
server_key: "2fbe9431cfb3ffff17d7d5ebdb203b64"
server_key_iv: "11cfb48eac37ece29fb88018b44298cb"
server_key_version: "encryptionkey@0"
I20260807 22:37:44.878140 28039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:44.889250 28039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:44.891928 28039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:44.892074 28039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:44.899883 28039 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:44771
I20260807 22:37:44.899894 28121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:44771 every 8 connection(s)
I20260807 22:37:44.900810 28039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:37:44.903493 28122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:44.908824 28122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22: Bootstrap starting.
I20260807 22:37:44.911105 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 28039
I20260807 22:37:44.911201 28122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:44.911231 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:37:44.911520 26833 external_mini_cluster.cc:1428] Setting key 0594be1be599d5d53dfdffc1f10a114e
I20260807 22:37:44.912081 28122 log.cc:824] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:44.914152 28122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22: No bootstrap required, opened a new log
I20260807 22:37:44.917682 28122 raft_consensus.cc:348] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790ce382a52a423ca02069c8397ecf22" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 44771 } }
I20260807 22:37:44.917917 28122 raft_consensus.cc:374] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:44.917994 28122 raft_consensus.cc:729] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 790ce382a52a423ca02069c8397ecf22, State: Initialized, Role: FOLLOWER
I20260807 22:37:44.918437 28122 consensus_queue.cc:260] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790ce382a52a423ca02069c8397ecf22" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 44771 } }
I20260807 22:37:44.918604 28122 raft_consensus.cc:388] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:37:44.918692 28122 raft_consensus.cc:482] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:37:44.918817 28122 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:44.919813 28122 raft_consensus.cc:504] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790ce382a52a423ca02069c8397ecf22" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 44771 } }
Aug 07 22:37:44 dist-test-slave-8w9v krb5kdc[28023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:44.920215 28122 leader_election.cc:302] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 790ce382a52a423ca02069c8397ecf22; no voters:
I20260807 22:37:44.920565 28122 leader_election.cc:288] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:37:44.920672 28127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:44.920948 28127 raft_consensus.cc:686] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [term 1 LEADER]: Becoming Leader. State: Replica: 790ce382a52a423ca02069c8397ecf22, State: Running, Role: LEADER
I20260807 22:37:44.921290 28127 consensus_queue.cc:237] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790ce382a52a423ca02069c8397ecf22" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 44771 } }
I20260807 22:37:44.921866 28122 sys_catalog.cc:564] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:37:44.923110 28129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 790ce382a52a423ca02069c8397ecf22. Latest consensus state: current_term: 1 leader_uuid: "790ce382a52a423ca02069c8397ecf22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790ce382a52a423ca02069c8397ecf22" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 44771 } } }
I20260807 22:37:44.923252 28129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:44.923604 28128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "790ce382a52a423ca02069c8397ecf22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "790ce382a52a423ca02069c8397ecf22" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 44771 } } }
I20260807 22:37:44.923704 28128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22 [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:44.926299 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:44.912664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39094 (local address 127.26.52.126:44771)
0807 22:37:44.913054 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:44.913070 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:44.913103 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:37:44.913705 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:44.913720 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:44.914024 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:44.914349 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:44.915178 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:44.916213 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:44.917050 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:44.917526 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:44.917699 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:44.920812 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:44.920819 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:44.920837 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:44.920870 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:44.922939 (+ 2069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:44.923495 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:44.923501 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:44.923508 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:44.923660 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:44.924015 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:44.924018 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:44.924020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:44.924535 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:44.924749 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:44.925096 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 22:37:44.925377 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":121,"threads_started":1}
W20260807 22:37:44.927131 28146 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:37:44.927211 28146 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:37:44.927270 28140 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:37:44.928071 28140 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:37:44.933077 28140 catalog_manager.cc:1347] Generated new cluster ID: 739ce4b9bf5d4cf48b0fc4fdb4078c0f
I20260807 22:37:44.933142 28140 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:37:44.966320 28140 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:37:44.967289 28140 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:37:44.971212 28140 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22: Generated new TSK 0
I20260807 22:37:44.971850 28140 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:37:45.006946 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:44771
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:35639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:45.145208 28153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:45.145437 28153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:45.145481 28153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:45.149278 28153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:45.149326 28153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:45.149363 28153 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:37:45.149408 28153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:37:45.154362 28153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.52.126:44771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:45.155262 28153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:45.156216 28153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:45.165470 28158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:45.165527 28161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:45.165472 28159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:45.165683 28153 server_base.cc:1034] running on GCE node
I20260807 22:37:45.166126 28153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:45.166725 28153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:45.167929 28153 hybrid_clock.cc:648] HybridClock initialized: now 1786142265167912 us; error 38 us; skew 500 ppm
Aug 07 22:37:45 dist-test-slave-8w9v krb5kdc[28023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142265, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:45.170761 28153 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:37:45.171697 28153 webserver.cc:460] Webserver started at http://127.26.52.65:42899/ using document root <none> and password file <none>
I20260807 22:37:45.172333 28153 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:45.172431 28153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:45.172672 28153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:45.174686 28153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "72eafec779974b68a8cc586d055244cb"
format_stamp: "Formatted at 2026-08-07 22:37:45 on dist-test-slave-8w9v"
server_key: "f4c9fe0aee3e36e576ceeff0e3d23ef3"
server_key_iv: "79fa274d6e658a01064ba7051ce48f19"
server_key_version: "encryptionkey@0"
I20260807 22:37:45.175256 28153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "72eafec779974b68a8cc586d055244cb"
format_stamp: "Formatted at 2026-08-07 22:37:45 on dist-test-slave-8w9v"
server_key: "f4c9fe0aee3e36e576ceeff0e3d23ef3"
server_key_iv: "79fa274d6e658a01064ba7051ce48f19"
server_key_version: "encryptionkey@0"
I20260807 22:37:45.178968 28153 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:37:45.181576 28169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:45.182761 28153 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:37:45.182914 28153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "72eafec779974b68a8cc586d055244cb"
format_stamp: "Formatted at 2026-08-07 22:37:45 on dist-test-slave-8w9v"
server_key: "f4c9fe0aee3e36e576ceeff0e3d23ef3"
server_key_iv: "79fa274d6e658a01064ba7051ce48f19"
server_key_version: "encryptionkey@0"
I20260807 22:37:45.183027 28153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:45.201217 28153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:45.203903 28153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:45.204105 28153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:45.205554 28153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:45.205623 28153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:45.205683 28153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:45.205736 28153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:37:45 dist-test-slave-8w9v krb5kdc[28023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142265, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:45.216791 28153 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:38979
I20260807 22:37:45.216940 28302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:38979 every 8 connection(s)
I20260807 22:37:45.217711 28153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:37:45.220600 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.206240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:41709 (local address 127.26.52.126:44771)
0807 22:37:45.206376 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.206381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.207769 (+ 1388us) server_negotiation.cc:407] Connection header received
0807 22:37:45.209227 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.209231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.209290 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.209375 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:45.210994 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.211657 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.213486 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.213699 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.213781 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.216838 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:45.216844 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:45.216847 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:45.216879 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:45.218721 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.219213 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.219215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.219217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.219293 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.219608 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.219610 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.219611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.219778 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:45.219851 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.220359 (+ 508us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.220475 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:37:45.221366 28180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.207107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:44771 (local address 127.26.52.65:41709)
0807 22:37:45.207587 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.207646 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.208936 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.209589 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.209600 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.210105 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:45.210820 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.210844 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.211799 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.211803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.213355 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.213365 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.213887 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.213892 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.214111 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.214783 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:45.214809 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:45.216663 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:45.218856 (+ 2193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.218861 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.218871 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.219119 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.219393 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.219395 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.219397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.219522 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.219861 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:45.219866 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:45.220082 (+ 216us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.220292 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.220526 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":97,"threads_started":1}
I20260807 22:37:45.222731 28304 heartbeater.cc:347] Connected to a master server at 127.26.52.126:44771
I20260807 22:37:45.222913 28304 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:45.223488 28304 heartbeater.cc:511] Master 127.26.52.126:44771 requested a full tablet report, sending...
I20260807 22:37:45.224316 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 28153
I20260807 22:37:45.224457 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:37:45.224720 26833 external_mini_cluster.cc:1428] Setting key dee3d420c4141ccf5ce4c5dac9f814d9
I20260807 22:37:45.225247 28071 ts_manager.cc:194] Registered new tserver with Master: 72eafec779974b68a8cc586d055244cb (127.26.52.65:38979)
I20260807 22:37:45.226613 28071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:41709
I20260807 22:37:45.233191 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.225238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:38949 (local address 127.26.52.126:44771)
0807 22:37:45.225350 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.225353 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.225713 (+ 360us) server_negotiation.cc:407] Connection header received
0807 22:37:45.225793 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.225795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.225839 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.225915 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:45.226400 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.227076 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.228216 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.228630 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.228740 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.229993 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:45.229996 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:45.229998 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:45.230019 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:45.231439 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.231940 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.231942 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.231943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.232038 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.232393 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.232395 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.232396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.232554 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:45.232628 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.232945 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.233036 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:37:45.233300 28311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.225181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:44771 (local address 127.26.52.65:38949)
0807 22:37:45.225616 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.225631 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.225722 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.225941 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.225944 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.226163 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:45.226277 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.226284 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.227223 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.227232 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.228069 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.228079 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.228758 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.228761 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.228851 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.229363 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:45.229390 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:45.229859 (+ 469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:45.231552 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.231556 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.231559 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.231839 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.232167 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.232173 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.232177 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.232285 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.232654 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:45.232659 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:45.232772 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.232899 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.233068 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":3,"thread_start_us":88,"threads_started":1}
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:37:45.253075 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:44771
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:35639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:45.364825 28315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:45.365087 28315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:45.365170 28315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:45.369365 28315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:45.369457 28315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:45.369541 28315 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:37:45.369619 28315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:37:45.374782 28315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.52.126:44771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:45.375830 28315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:45.376978 28315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:45.386688 28320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:45.386726 28323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:45.386729 28321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:45.386849 28315 server_base.cc:1034] running on GCE node
I20260807 22:37:45.387449 28315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:45.388091 28315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:45.389299 28315 hybrid_clock.cc:648] HybridClock initialized: now 1786142265389268 us; error 41 us; skew 500 ppm
Aug 07 22:37:45 dist-test-slave-8w9v krb5kdc[28023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142265, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:45.391906 28315 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:37:45.392782 28315 webserver.cc:460] Webserver started at http://127.26.52.66:43031/ using document root <none> and password file <none>
I20260807 22:37:45.393321 28315 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:45.393379 28315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:45.393549 28315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:45.395583 28315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "17e92d3792ac4a7586e7b09d3859b9e6"
format_stamp: "Formatted at 2026-08-07 22:37:45 on dist-test-slave-8w9v"
server_key: "57e6ee995693b1a313048ab930fe73f6"
server_key_iv: "cbcd753b380a489cd2aa68afab67a636"
server_key_version: "encryptionkey@0"
I20260807 22:37:45.396106 28315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "17e92d3792ac4a7586e7b09d3859b9e6"
format_stamp: "Formatted at 2026-08-07 22:37:45 on dist-test-slave-8w9v"
server_key: "57e6ee995693b1a313048ab930fe73f6"
server_key_iv: "cbcd753b380a489cd2aa68afab67a636"
server_key_version: "encryptionkey@0"
I20260807 22:37:45.399784 28315 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 22:37:45.402104 28330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:45.403280 28315 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:37:45.403409 28315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "17e92d3792ac4a7586e7b09d3859b9e6"
format_stamp: "Formatted at 2026-08-07 22:37:45 on dist-test-slave-8w9v"
server_key: "57e6ee995693b1a313048ab930fe73f6"
server_key_iv: "cbcd753b380a489cd2aa68afab67a636"
server_key_version: "encryptionkey@0"
I20260807 22:37:45.403530 28315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:45.422309 28315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:45.425844 28315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:45.426036 28315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:45.427397 28315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:45.427486 28315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:45.427547 28315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:45.427604 28315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:37:45 dist-test-slave-8w9v krb5kdc[28023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142265, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:45.438205 28315 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:35355
I20260807 22:37:45.438283 28454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:35355 every 8 connection(s)
I20260807 22:37:45.439271 28315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:37:45.439436 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 28315
I20260807 22:37:45.439533 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:37:45.439852 26833 external_mini_cluster.cc:1428] Setting key 7dccc4b37cb99b89392ea0931ad459dc
I20260807 22:37:45.443070 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.428240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:57297 (local address 127.26.52.126:44771)
0807 22:37:45.428391 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.428396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.429279 (+ 883us) server_negotiation.cc:407] Connection header received
0807 22:37:45.430432 (+ 1153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.430438 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.430511 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.430618 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:45.432386 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.433395 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.435321 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.435548 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.435642 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.438849 (+ 3207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:45.438856 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:45.438863 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:45.438899 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:45.440730 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.441402 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.441408 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.441410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.441506 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.441953 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.441956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.441957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.442163 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:45.442269 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.442850 (+ 581us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.442950 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:37:45.444226 28340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.428657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:44771 (local address 127.26.52.66:57297)
0807 22:37:45.429124 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.429172 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.430186 (+ 1014us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.430968 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.430977 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.431445 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:45.432216 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.432239 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.433571 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.433577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.435150 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.435160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.435725 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.435731 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.435977 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.436723 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:45.436749 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:45.438670 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:45.440949 (+ 2279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.440954 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.440964 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.441271 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.441592 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.441594 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.441595 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.441800 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.442278 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:45.442286 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:45.442588 (+ 302us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.442789 (+ 201us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.443130 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":131,"threads_started":1}
I20260807 22:37:45.445475 28456 heartbeater.cc:347] Connected to a master server at 127.26.52.126:44771
I20260807 22:37:45.445605 28456 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:45.446165 28456 heartbeater.cc:511] Master 127.26.52.126:44771 requested a full tablet report, sending...
I20260807 22:37:45.447253 28072 ts_manager.cc:194] Registered new tserver with Master: 17e92d3792ac4a7586e7b09d3859b9e6 (127.26.52.66:35355)
I20260807 22:37:45.447978 28072 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:57297
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
I20260807 22:37:45.456661 28464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.447750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:44771 (local address 127.26.52.66:50521)
0807 22:37:45.448424 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.448444 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.448546 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.450015 (+ 1469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.450018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.450213 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:45.450306 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.450312 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.451080 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.451084 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.451609 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.451616 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.452255 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.452259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.452358 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.452933 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:45.452944 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:45.453233 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:45.455011 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.455016 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.455020 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.455276 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.455576 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.455578 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.455579 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.455709 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.456272 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:45.456275 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:45.456349 (+ 74us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.456430 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.456527 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":107,"threads_started":1}
I20260807 22:37:45.456707 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.447811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:50521 (local address 127.26.52.126:44771)
0807 22:37:45.447906 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.447910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.448509 (+ 599us) server_negotiation.cc:407] Connection header received
0807 22:37:45.449858 (+ 1349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.449861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.449913 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.449999 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:45.450417 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.450964 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.451723 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.452102 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.452259 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.453403 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:45.453407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:45.453409 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:45.453433 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:45.454889 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.455375 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.455381 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.455383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.455477 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.455816 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.455820 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.455823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.456158 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:45.456278 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.456511 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.456601 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:37:45.469337 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:44771
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:35639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:45.579610 28466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:45.579883 28466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:45.579972 28466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:45.584108 28466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:45.584199 28466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:45.584264 28466 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:37:45.584340 28466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:37:45.589444 28466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.52.126:44771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:45.590412 28466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:45.591372 28466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:45.600647 28474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:45.600658 28471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:45.600663 28472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:45.600881 28466 server_base.cc:1034] running on GCE node
I20260807 22:37:45.601380 28466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:45.601926 28466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:45.603086 28466 hybrid_clock.cc:648] HybridClock initialized: now 1786142265603067 us; error 29 us; skew 500 ppm
Aug 07 22:37:45 dist-test-slave-8w9v krb5kdc[28023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142265, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:45.605751 28466 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:37:45.606617 28466 webserver.cc:460] Webserver started at http://127.26.52.67:34101/ using document root <none> and password file <none>
I20260807 22:37:45.607265 28466 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:45.607333 28466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:45.607563 28466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:45.609614 28466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "a3dfb7b30609429285b60d5b63725384"
format_stamp: "Formatted at 2026-08-07 22:37:45 on dist-test-slave-8w9v"
server_key: "9a515971d67ae17124ae3c7e444f0f8f"
server_key_iv: "fcf194c0566b25235adcedc336cb0ae1"
server_key_version: "encryptionkey@0"
I20260807 22:37:45.610172 28466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "a3dfb7b30609429285b60d5b63725384"
format_stamp: "Formatted at 2026-08-07 22:37:45 on dist-test-slave-8w9v"
server_key: "9a515971d67ae17124ae3c7e444f0f8f"
server_key_iv: "fcf194c0566b25235adcedc336cb0ae1"
server_key_version: "encryptionkey@0"
I20260807 22:37:45.613843 28466 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:37:45.616242 28481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:45.617400 28466 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:45.617535 28466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "a3dfb7b30609429285b60d5b63725384"
format_stamp: "Formatted at 2026-08-07 22:37:45 on dist-test-slave-8w9v"
server_key: "9a515971d67ae17124ae3c7e444f0f8f"
server_key_iv: "fcf194c0566b25235adcedc336cb0ae1"
server_key_version: "encryptionkey@0"
I20260807 22:37:45.617645 28466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:45.633674 28466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:45.636524 28466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:45.636723 28466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:45.638120 28466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:45.638193 28466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:45.638260 28466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:45.638311 28466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:45.648777 28466 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:36373
I20260807 22:37:45.648811 28605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:36373 every 8 connection(s)
I20260807 22:37:45.649610 28466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:37:45 dist-test-slave-8w9v krb5kdc[28023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142265, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:45.655755 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 28466
I20260807 22:37:45.655885 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:37:45.656260 26833 external_mini_cluster.cc:1428] Setting key b07b735bfc50cb5b0e8416546e6525a5
I20260807 22:37:45.656491 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.638910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:37063 (local address 127.26.52.126:44771)
0807 22:37:45.639039 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.639043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.640044 (+ 1001us) server_negotiation.cc:407] Connection header received
0807 22:37:45.641065 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.641069 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.641133 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.641226 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:45.642843 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.643675 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.645150 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.645523 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.645640 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.652963 (+ 7323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:45.652966 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:45.652968 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:45.652993 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:45.654456 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.654894 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.654897 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.654898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.654972 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.655255 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.655257 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.655259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.655434 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:45.655506 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.656195 (+ 689us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.656301 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:37:45.657407 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.639435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:44771 (local address 127.26.52.67:37063)
0807 22:37:45.639899 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.639941 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.640854 (+ 913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.641454 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.641463 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.641977 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:45.642656 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.642680 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.643802 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.643807 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.645015 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.645026 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.645709 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.645714 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.645936 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.651334 (+ 5398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:45.651349 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:45.652809 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:45.654555 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.654559 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.654569 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.654803 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.655050 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.655052 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.655053 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.655173 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.655567 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:45.655575 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:45.655876 (+ 301us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.656088 (+ 212us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.656444 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":138,"threads_started":1}
I20260807 22:37:45.658560 28606 heartbeater.cc:347] Connected to a master server at 127.26.52.126:44771
I20260807 22:37:45.658699 28606 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:45.659221 28606 heartbeater.cc:511] Master 127.26.52.126:44771 requested a full tablet report, sending...
I20260807 22:37:45.660297 28072 ts_manager.cc:194] Registered new tserver with Master: a3dfb7b30609429285b60d5b63725384 (127.26.52.67:36373)
I20260807 22:37:45.660898 28072 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:37063
I20260807 22:37:45.667299 28613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.660821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:44771 (local address 127.26.52.67:57987)
0807 22:37:45.661210 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.661226 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.661318 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.661555 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.661558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.661758 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:45.661920 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.661937 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.662636 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.662639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.663308 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.663317 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.663685 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.663687 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.663747 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.664252 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:45.664266 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:45.664561 (+ 295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:45.665995 (+ 1434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.665997 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.665999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.666213 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.666515 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:45.666517 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:45.666518 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:45.666591 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:45.666897 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:45.666899 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:45.666993 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.667071 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.667168 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":6,"thread_start_us":112,"threads_started":1}
I20260807 22:37:45.667313 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.660898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:57987 (local address 127.26.52.126:44771)
0807 22:37:45.661029 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.661036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.661299 (+ 263us) server_negotiation.cc:407] Connection header received
0807 22:37:45.661394 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.661397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.661440 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.661531 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:45.662043 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.662510 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.663404 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.663596 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.663667 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.664679 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:45.664682 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:45.664684 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:45.664702 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:45.665891 (+ 1189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.666307 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.666311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.666312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.666433 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.666668 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.666670 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.666671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.666820 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:45.666893 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.667129 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.667213 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:37:45.670235 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 22:37:45 dist-test-slave-8w9v krb5kdc[28023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142265, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:37:45 dist-test-slave-8w9v krb5kdc[28023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142265, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:45.696218 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.688305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39108 (local address 127.26.52.126:44771)
0807 22:37:45.688435 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.688439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.688451 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:37:45.688488 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.688490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.688527 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.688592 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:45.689262 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.689745 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.690491 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.690705 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.690820 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.693287 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:45.693291 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:45.693293 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:45.693315 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:45.694485 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.694896 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.694899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.694900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.694982 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:45.695281 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:45.695284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:45.695286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:45.695475 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:45.695620 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.695863 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.696007 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:37:45.698853 28072 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:37:45.701960 28072 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:37:45.716661 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.710512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:36373 (local address 127.0.0.1:41538)
0807 22:37:45.711092 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.711137 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.711278 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.712190 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.712196 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.712226 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:45.712497 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.712507 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.713865 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.713869 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.715061 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.715071 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.716073 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.716077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.716263 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.716313 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.716378 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.716516 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":271,"spinlock_wait_cycles":11008,"thread_start_us":88,"threads_started":1}
I20260807 22:37:45.716665 28630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.710368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:35355 (local address 127.0.0.1:53364)
0807 22:37:45.711090 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.711137 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.711278 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.712190 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.712196 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.712240 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:45.712502 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.712508 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.713902 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.713904 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.714999 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.715008 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.716073 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.716077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.716298 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.716339 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.716409 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.716491 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"mutex_wait_us":168,"spinlock_wait_cycles":9472,"thread_start_us":75,"threads_started":1}
I20260807 22:37:45.716756 28629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.710514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53364 (local address 127.26.52.66:35355)
0807 22:37:45.711696 (+ 1182us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.711706 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.711726 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:37:45.711786 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.711791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.711987 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.712425 (+ 438us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:45.712603 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.713739 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.715112 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.715913 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.716282 (+ 369us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.716479 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.716530 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.716612 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1091,"thread_start_us":100,"threads_started":1}
I20260807 22:37:45.716823 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.711146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41834 (local address 127.26.52.65:38979)
0807 22:37:45.711559 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.711575 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.711758 (+ 183us) server_negotiation.cc:407] Connection header received
0807 22:37:45.711837 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.711842 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.712032 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.712298 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:45.712753 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.713449 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.715379 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.715883 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.716017 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.716217 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.716575 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.716665 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":93,"threads_started":1}
I20260807 22:37:45.717078 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.710719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38979 (local address 127.0.0.1:41834)
0807 22:37:45.711569 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.711583 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.711665 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.712197 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.712199 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.712285 (+ 86us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:45.712646 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.712653 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.713563 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.713569 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.715269 (+ 1700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.715276 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.716019 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.716023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.716174 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.716230 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.716338 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.716491 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"mutex_wait_us":42,"spinlock_wait_cycles":106240,"thread_start_us":91,"threads_started":1}
I20260807 22:37:45.718665 28631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.711114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41538 (local address 127.26.52.67:36373)
0807 22:37:45.711671 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.711684 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.711709 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:37:45.711785 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.711791 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.711988 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.712473 (+ 485us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:45.712606 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.713740 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.715161 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.715923 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.718311 (+ 2388us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.718454 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.718495 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.718563 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":122,"threads_started":1}
I20260807 22:37:45.719997 28229 tablet_service.cc:1467] Processing CreateTablet for tablet 169ac454be784bc3b8c8c39ddcc0b84d (DEFAULT_TABLE table=test-table [id=dad5711e3700402eabafd91b00472856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:45.721053 28229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 169ac454be784bc3b8c8c39ddcc0b84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:45.721176 28537 tablet_service.cc:1467] Processing CreateTablet for tablet 169ac454be784bc3b8c8c39ddcc0b84d (DEFAULT_TABLE table=test-table [id=dad5711e3700402eabafd91b00472856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:45.722317 28537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 169ac454be784bc3b8c8c39ddcc0b84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:45.721992 28383 tablet_service.cc:1467] Processing CreateTablet for tablet 169ac454be784bc3b8c8c39ddcc0b84d (DEFAULT_TABLE table=test-table [id=dad5711e3700402eabafd91b00472856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:45.722894 28383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 169ac454be784bc3b8c8c39ddcc0b84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:45.727488 28633 tablet_bootstrap.cc:492] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: Bootstrap starting.
I20260807 22:37:45.729890 28633 tablet_bootstrap.cc:654] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:45.730363 28634 tablet_bootstrap.cc:492] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: Bootstrap starting.
I20260807 22:37:45.730801 28633 log.cc:824] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:45.731525 28635 tablet_bootstrap.cc:492] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: Bootstrap starting.
I20260807 22:37:45.732849 28634 tablet_bootstrap.cc:654] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:45.733914 28634 log.cc:824] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:45.736495 28634 tablet_bootstrap.cc:492] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: No bootstrap required, opened a new log
I20260807 22:37:45.736696 28634 ts_tablet_manager.cc:1397] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:37:45.736792 28633 tablet_bootstrap.cc:492] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: No bootstrap required, opened a new log
I20260807 22:37:45.736975 28633 ts_tablet_manager.cc:1397] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.001s
I20260807 22:37:45.741570 28634 raft_consensus.cc:348] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } }
I20260807 22:37:45.741570 28633 raft_consensus.cc:348] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } }
I20260807 22:37:45.741855 28633 raft_consensus.cc:374] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:45.741855 28634 raft_consensus.cc:374] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:45.741928 28634 raft_consensus.cc:729] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17e92d3792ac4a7586e7b09d3859b9e6, State: Initialized, Role: FOLLOWER
I20260807 22:37:45.741917 28633 raft_consensus.cc:729] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72eafec779974b68a8cc586d055244cb, State: Initialized, Role: FOLLOWER
I20260807 22:37:45.742439 28634 consensus_queue.cc:260] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } }
I20260807 22:37:45.742429 28633 consensus_queue.cc:260] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } }
I20260807 22:37:45.743268 28304 heartbeater.cc:503] Master 127.26.52.126:44771 was elected leader, sending a full tablet report...
I20260807 22:37:45.743494 28633 ts_tablet_manager.cc:1428] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260807 22:37:45.743499 28456 heartbeater.cc:503] Master 127.26.52.126:44771 was elected leader, sending a full tablet report...
I20260807 22:37:45.743494 28634 ts_tablet_manager.cc:1428] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 22:37:45.745091 28635 tablet_bootstrap.cc:654] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:45.746050 28635 log.cc:824] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:45.748358 28635 tablet_bootstrap.cc:492] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: No bootstrap required, opened a new log
I20260807 22:37:45.748574 28635 ts_tablet_manager.cc:1397] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260807 22:37:45.752667 28635 raft_consensus.cc:348] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } }
I20260807 22:37:45.752960 28635 raft_consensus.cc:374] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:45.753024 28635 raft_consensus.cc:729] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dfb7b30609429285b60d5b63725384, State: Initialized, Role: FOLLOWER
I20260807 22:37:45.753484 28635 consensus_queue.cc:260] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } }
I20260807 22:37:45.754295 28606 heartbeater.cc:503] Master 127.26.52.126:44771 was elected leader, sending a full tablet report...
I20260807 22:37:45.754545 28635 ts_tablet_manager.cc:1428] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260807 22:37:45.900498 28607 tablet.cc:2369] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:37:45.908900 28642 raft_consensus.cc:482] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:37:45.909119 28642 raft_consensus.cc:504] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } }
I20260807 22:37:45.910202 28642 leader_election.cc:288] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17e92d3792ac4a7586e7b09d3859b9e6 (127.26.52.66:35355), 72eafec779974b68a8cc586d055244cb (127.26.52.65:38979)
I20260807 22:37:45.914186 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.910430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:35355 (local address 127.26.52.67:34585)
0807 22:37:45.910552 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.910567 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.910653 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.911091 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.911096 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.911121 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:45.911257 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.911267 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.912311 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.912316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.913093 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.913102 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.913745 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.913748 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.913869 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.913887 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.913981 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.914053 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 22:37:45.914186 28629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.910744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:34585 (local address 127.26.52.66:35355)
0807 22:37:45.910861 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.910865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.910877 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:37:45.910937 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.910940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.910983 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.911060 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:45.911362 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.912228 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.913216 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.913621 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.913750 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.913809 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.913999 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.914065 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:37:45.914939 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.910573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:53463 (local address 127.26.52.65:38979)
0807 22:37:45.910757 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.910762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.911162 (+ 400us) server_negotiation.cc:407] Connection header received
0807 22:37:45.911347 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.911351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.911397 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.911473 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:45.912263 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.912821 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.913824 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.914217 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.914375 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.914428 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.914743 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.914820 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 22:37:45.914994 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.910435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38979 (local address 127.26.52.67:53463)
0807 22:37:45.911076 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:45.911089 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:45.911224 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:45.911524 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:45.911527 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:45.911546 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:45.912115 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.912152 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.912947 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.912953 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.913698 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:45.913707 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.914505 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.914509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:45.914613 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.914630 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 22:37:45.914723 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 22:37:45.914790 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":291,"thread_start_us":145,"threads_started":1}
I20260807 22:37:45.914911 28407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169ac454be784bc3b8c8c39ddcc0b84d" candidate_uuid: "a3dfb7b30609429285b60d5b63725384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" is_pre_election: true
I20260807 22:37:45.915227 28407 raft_consensus.cc:2454] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3dfb7b30609429285b60d5b63725384 in term 0.
I20260807 22:37:45.915755 28483 leader_election.cc:302] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17e92d3792ac4a7586e7b09d3859b9e6, a3dfb7b30609429285b60d5b63725384; no voters:
I20260807 22:37:45.915745 28252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169ac454be784bc3b8c8c39ddcc0b84d" candidate_uuid: "a3dfb7b30609429285b60d5b63725384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72eafec779974b68a8cc586d055244cb" is_pre_election: true
I20260807 22:37:45.916036 28642 raft_consensus.cc:2781] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:37:45.916059 28252 raft_consensus.cc:2454] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3dfb7b30609429285b60d5b63725384 in term 0.
I20260807 22:37:45.916158 28642 raft_consensus.cc:482] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:37:45.916217 28642 raft_consensus.cc:3037] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:45.917342 28642 raft_consensus.cc:504] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } }
I20260807 22:37:45.917707 28642 leader_election.cc:288] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [CANDIDATE]: Term 1 election: Requested vote from peers 17e92d3792ac4a7586e7b09d3859b9e6 (127.26.52.66:35355), 72eafec779974b68a8cc586d055244cb (127.26.52.65:38979)
I20260807 22:37:45.918017 28407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169ac454be784bc3b8c8c39ddcc0b84d" candidate_uuid: "a3dfb7b30609429285b60d5b63725384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17e92d3792ac4a7586e7b09d3859b9e6"
I20260807 22:37:45.918088 28252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "169ac454be784bc3b8c8c39ddcc0b84d" candidate_uuid: "a3dfb7b30609429285b60d5b63725384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72eafec779974b68a8cc586d055244cb"
I20260807 22:37:45.918143 28407 raft_consensus.cc:3037] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:45.918226 28252 raft_consensus.cc:3037] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:45.919219 28252 raft_consensus.cc:2454] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dfb7b30609429285b60d5b63725384 in term 1.
I20260807 22:37:45.919546 28482 leader_election.cc:302] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72eafec779974b68a8cc586d055244cb, a3dfb7b30609429285b60d5b63725384; no voters:
I20260807 22:37:45.919730 28642 raft_consensus.cc:2781] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:45.919956 28642 raft_consensus.cc:686] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 1 LEADER]: Becoming Leader. State: Replica: a3dfb7b30609429285b60d5b63725384, State: Running, Role: LEADER
I20260807 22:37:45.920166 28407 raft_consensus.cc:2454] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dfb7b30609429285b60d5b63725384 in term 1.
I20260807 22:37:45.920307 28642 consensus_queue.cc:237] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } }
I20260807 22:37:45.923696 28072 catalog_manager.cc:5495] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3dfb7b30609429285b60d5b63725384 (127.26.52.67). New cstate: current_term: 1 leader_uuid: "a3dfb7b30609429285b60d5b63725384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } health_report { overall_health: UNKNOWN } } }
W20260807 22:37:45.941313 28457 tablet.cc:2369] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:37:45.967563 28631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:45.964060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41548 (local address 127.26.52.67:36373)
0807 22:37:45.964220 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:45.964224 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:45.964244 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:37:45.964455 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:45.964457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:45.964511 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:45.964594 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:45.964826 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.965361 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.966180 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:45.966380 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:45.966460 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:45.966727 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:45.967203 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:45.967289 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:45.967402 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 22:37:45.967452 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260807 22:37:45.969161 28305 tablet.cc:2369] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:37:45.973939 28252 raft_consensus.cc:1261] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb [term 1 FOLLOWER]: Refusing update from remote peer a3dfb7b30609429285b60d5b63725384: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:45.974820 28642 consensus_queue.cc:1035] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:45.975308 28407 raft_consensus.cc:1261] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 FOLLOWER]: Refusing update from remote peer a3dfb7b30609429285b60d5b63725384: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:45.976003 28642 consensus_queue.cc:1035] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:45.983062 28648 mvcc.cc:205] Tried to move back new op lower bound from 7316038721420349440 to 7316038721212358656. Current Snapshot: MvccSnapshot[applied={T|T < 7316038721420349440}]
I20260807 22:37:45.983804 28647 mvcc.cc:205] Tried to move back new op lower bound from 7316038721420349440 to 7316038721212358656. Current Snapshot: MvccSnapshot[applied={T|T < 7316038721420349440}]
I20260807 22:37:45.984356 28649 mvcc.cc:205] Tried to move back new op lower bound from 7316038721420349440 to 7316038721212358656. Current Snapshot: MvccSnapshot[applied={T|T < 7316038721420349440}]
I20260807 22:37:45.996248 28071 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:45.996505 28071 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:45.999451 28071 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22: Sending DeleteTablet for 3 replicas of tablet 169ac454be784bc3b8c8c39ddcc0b84d
I20260807 22:37:46.000449 28383 tablet_service.cc:1514] Processing DeleteTablet for tablet 169ac454be784bc3b8c8c39ddcc0b84d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:45 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:53364
I20260807 22:37:46.000509 28229 tablet_service.cc:1514] Processing DeleteTablet for tablet 169ac454be784bc3b8c8c39ddcc0b84d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:45 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:41834
I20260807 22:37:46.001022 28537 tablet_service.cc:1514] Processing DeleteTablet for tablet 169ac454be784bc3b8c8c39ddcc0b84d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:45 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:41538
I20260807 22:37:46.001453 28657 tablet_replica.cc:330] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: stopping tablet replica
I20260807 22:37:46.001439 28071 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 22:37:46.001703 28659 tablet_replica.cc:330] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: stopping tablet replica
I20260807 22:37:46.001772 28657 raft_consensus.cc:2229] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 22:37:46.001830 28071 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:37:46.002022 28659 raft_consensus.cc:2229] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:37:46.002095 28657 raft_consensus.cc:2258] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:46.002454 28659 raft_consensus.cc:2258] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:46.004273 28659 ts_tablet_manager.cc:1905] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:46.007114 28229 tablet_service.cc:1467] Processing CreateTablet for tablet 6179af3e5e83427bb9c27c2eb47271b2 (DEFAULT_TABLE table=test-table [id=ec5d0763f9a6406d9a4a19bd2468e04f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:46.007288 28537 tablet_service.cc:1467] Processing CreateTablet for tablet 6179af3e5e83427bb9c27c2eb47271b2 (DEFAULT_TABLE table=test-table [id=ec5d0763f9a6406d9a4a19bd2468e04f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:46.007536 28537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6179af3e5e83427bb9c27c2eb47271b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:46.008491 28659 ts_tablet_manager.cc:1918] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:37:46.008610 28659 log.cc:1196] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/169ac454be784bc3b8c8c39ddcc0b84d
I20260807 22:37:46.009043 28659 ts_tablet_manager.cc:1939] T 169ac454be784bc3b8c8c39ddcc0b84d P a3dfb7b30609429285b60d5b63725384: Deleting consensus metadata
I20260807 22:37:46.009706 28635 tablet_bootstrap.cc:492] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384: Bootstrap starting.
I20260807 22:37:46.010464 28229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6179af3e5e83427bb9c27c2eb47271b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:46.010658 28383 tablet_service.cc:1467] Processing CreateTablet for tablet 6179af3e5e83427bb9c27c2eb47271b2 (DEFAULT_TABLE table=test-table [id=ec5d0763f9a6406d9a4a19bd2468e04f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:46.010964 28383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6179af3e5e83427bb9c27c2eb47271b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:46.011173 28635 tablet_bootstrap.cc:654] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:46.013357 28634 tablet_bootstrap.cc:492] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6: Bootstrap starting.
I20260807 22:37:46.013556 28059 catalog_manager.cc:4841] TS a3dfb7b30609429285b60d5b63725384 (127.26.52.67:36373): tablet 169ac454be784bc3b8c8c39ddcc0b84d (table test-table [id=dad5711e3700402eabafd91b00472856]) successfully deleted
I20260807 22:37:46.014036 28658 tablet_replica.cc:330] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: stopping tablet replica
I20260807 22:37:46.014484 28658 raft_consensus.cc:2229] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:46.014824 28634 tablet_bootstrap.cc:654] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:46.014861 28658 raft_consensus.cc:2258] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:46.014972 28657 ts_tablet_manager.cc:1905] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:46.016098 28635 tablet_bootstrap.cc:492] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384: No bootstrap required, opened a new log
I20260807 22:37:46.016206 28635 ts_tablet_manager.cc:1397] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20260807 22:37:46.016523 28634 tablet_bootstrap.cc:492] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6: No bootstrap required, opened a new log
I20260807 22:37:46.016601 28634 ts_tablet_manager.cc:1397] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:37:46.016894 28635 raft_consensus.cc:348] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.017011 28635 raft_consensus.cc:374] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:46.017045 28635 raft_consensus.cc:729] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dfb7b30609429285b60d5b63725384, State: Initialized, Role: FOLLOWER
I20260807 22:37:46.017179 28635 consensus_queue.cc:260] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.017457 28635 ts_tablet_manager.cc:1428] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:37:46.017406 28634 raft_consensus.cc:348] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.017510 28634 raft_consensus.cc:374] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:46.017540 28634 raft_consensus.cc:729] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17e92d3792ac4a7586e7b09d3859b9e6, State: Initialized, Role: FOLLOWER
I20260807 22:37:46.017671 28633 tablet_bootstrap.cc:492] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb: Bootstrap starting.
I20260807 22:37:46.017658 28634 consensus_queue.cc:260] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.017939 28634 ts_tablet_manager.cc:1428] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 22:37:46.018906 28657 ts_tablet_manager.cc:1918] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:37:46.018990 28657 log.cc:1196] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/169ac454be784bc3b8c8c39ddcc0b84d
I20260807 22:37:46.019533 28633 tablet_bootstrap.cc:654] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:46.020973 28657 ts_tablet_manager.cc:1939] T 169ac454be784bc3b8c8c39ddcc0b84d P 17e92d3792ac4a7586e7b09d3859b9e6: Deleting consensus metadata
I20260807 22:37:46.021929 28633 tablet_bootstrap.cc:492] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb: No bootstrap required, opened a new log
I20260807 22:37:46.022054 28633 ts_tablet_manager.cc:1397] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.004s
I20260807 22:37:46.022485 28057 catalog_manager.cc:4841] TS 17e92d3792ac4a7586e7b09d3859b9e6 (127.26.52.66:35355): tablet 169ac454be784bc3b8c8c39ddcc0b84d (table test-table [id=dad5711e3700402eabafd91b00472856]) successfully deleted
I20260807 22:37:46.022864 28658 ts_tablet_manager.cc:1905] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:46.023183 28633 raft_consensus.cc:348] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.023314 28633 raft_consensus.cc:374] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:46.023360 28633 raft_consensus.cc:729] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72eafec779974b68a8cc586d055244cb, State: Initialized, Role: FOLLOWER
I20260807 22:37:46.023531 28633 consensus_queue.cc:260] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.023869 28633 ts_tablet_manager.cc:1428] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 22:37:46.026467 28658 ts_tablet_manager.cc:1918] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:37:46.026598 28658 log.cc:1196] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/169ac454be784bc3b8c8c39ddcc0b84d
I20260807 22:37:46.026962 28658 ts_tablet_manager.cc:1939] T 169ac454be784bc3b8c8c39ddcc0b84d P 72eafec779974b68a8cc586d055244cb: Deleting consensus metadata
I20260807 22:37:46.028251 28056 catalog_manager.cc:4841] TS 72eafec779974b68a8cc586d055244cb (127.26.52.65:38979): tablet 169ac454be784bc3b8c8c39ddcc0b84d (table test-table [id=dad5711e3700402eabafd91b00472856]) successfully deleted
I20260807 22:37:46.083041 28640 raft_consensus.cc:482] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:37:46.083225 28640 raft_consensus.cc:504] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.084851 28640 leader_election.cc:288] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72eafec779974b68a8cc586d055244cb (127.26.52.65:38979), a3dfb7b30609429285b60d5b63725384 (127.26.52.67:36373)
I20260807 22:37:46.089425 28631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.085258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:52329 (local address 127.26.52.67:36373)
0807 22:37:46.085624 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.085648 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.085795 (+ 147us) server_negotiation.cc:407] Connection header received
0807 22:37:46.086001 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.086007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.086152 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.086245 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:46.086564 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.087168 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.088475 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.088858 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.089002 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.089059 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.089234 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.089303 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260807 22:37:46.089452 28663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.085081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:36373 (local address 127.26.52.66:52329)
0807 22:37:46.085664 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:46.085682 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:46.085828 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:46.086257 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:46.086260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:46.086276 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:46.086442 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.086450 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.087286 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.087289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.088326 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.088336 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.089003 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.089007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.089100 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.089121 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:37:46.089215 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:37:46.089283 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":26,"thread_start_us":110,"threads_started":1}
I20260807 22:37:46.090260 28558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6179af3e5e83427bb9c27c2eb47271b2" candidate_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dfb7b30609429285b60d5b63725384" is_pre_election: true
I20260807 22:37:46.090555 28558 raft_consensus.cc:2454] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17e92d3792ac4a7586e7b09d3859b9e6 in term 0.
I20260807 22:37:46.091066 28334 leader_election.cc:302] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17e92d3792ac4a7586e7b09d3859b9e6, a3dfb7b30609429285b60d5b63725384; no voters:
I20260807 22:37:46.091342 28640 raft_consensus.cc:2781] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:37:46.091398 28640 raft_consensus.cc:482] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:37:46.091435 28640 raft_consensus.cc:3037] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:46.091526 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.085291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:37451 (local address 127.26.52.65:38979)
0807 22:37:46.085469 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.085475 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.085855 (+ 380us) server_negotiation.cc:407] Connection header received
0807 22:37:46.086113 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.086117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.086184 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.086272 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:46.086817 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.087577 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.090040 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.090699 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.090819 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.090877 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.091288 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.091390 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 22:37:46.091681 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.085081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38979 (local address 127.26.52.66:37451)
0807 22:37:46.085751 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:46.085784 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:46.085900 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:46.086480 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:46.086483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:46.086502 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:46.086632 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.086639 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.087794 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.087798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.089845 (+ 2047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.089858 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.090829 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.090834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.091064 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.091092 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 22:37:46.091181 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 22:37:46.091246 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":290,"thread_start_us":92,"threads_started":1}
I20260807 22:37:46.092475 28252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6179af3e5e83427bb9c27c2eb47271b2" candidate_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72eafec779974b68a8cc586d055244cb" is_pre_election: true
I20260807 22:37:46.092672 28252 raft_consensus.cc:2454] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17e92d3792ac4a7586e7b09d3859b9e6 in term 0.
I20260807 22:37:46.093240 28640 raft_consensus.cc:504] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.093657 28640 leader_election.cc:288] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [CANDIDATE]: Term 1 election: Requested vote from peers 72eafec779974b68a8cc586d055244cb (127.26.52.65:38979), a3dfb7b30609429285b60d5b63725384 (127.26.52.67:36373)
I20260807 22:37:46.094031 28558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6179af3e5e83427bb9c27c2eb47271b2" candidate_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dfb7b30609429285b60d5b63725384"
I20260807 22:37:46.094008 28252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6179af3e5e83427bb9c27c2eb47271b2" candidate_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72eafec779974b68a8cc586d055244cb"
I20260807 22:37:46.094147 28252 raft_consensus.cc:3037] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:46.094159 28558 raft_consensus.cc:3037] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:46.095278 28558 raft_consensus.cc:2454] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17e92d3792ac4a7586e7b09d3859b9e6 in term 1.
I20260807 22:37:46.095553 28334 leader_election.cc:302] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17e92d3792ac4a7586e7b09d3859b9e6, a3dfb7b30609429285b60d5b63725384; no voters:
I20260807 22:37:46.095626 28252 raft_consensus.cc:2454] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17e92d3792ac4a7586e7b09d3859b9e6 in term 1.
I20260807 22:37:46.095726 28640 raft_consensus.cc:2781] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:46.096005 28640 raft_consensus.cc:686] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 LEADER]: Becoming Leader. State: Replica: 17e92d3792ac4a7586e7b09d3859b9e6, State: Running, Role: LEADER
I20260807 22:37:46.096293 28640 consensus_queue.cc:237] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.098536 28070 catalog_manager.cc:5495] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17e92d3792ac4a7586e7b09d3859b9e6 (127.26.52.66). New cstate: current_term: 1 leader_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } health_report { overall_health: UNKNOWN } } }
Aug 07 22:37:46 dist-test-slave-8w9v krb5kdc[28023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142264, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:46.148070 28672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.137886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:44771 (local address 127.0.0.1:39118)
0807 22:37:46.138373 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:46.138388 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:46.138485 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:46.138770 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:46.138773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:46.139217 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:46.139311 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.139317 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.140739 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.140741 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.141311 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.141318 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.142033 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.142036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.142095 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.142766 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:46.142777 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:46.144362 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:46.146593 (+ 2231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:46.146604 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:46.146610 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:46.146857 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:46.147143 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:46.147145 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:46.147146 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:46.147216 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:46.147658 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:46.147663 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:46.147754 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 22:37:46.147836 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:37:46.147938 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":174,"threads_started":1}
I20260807 22:37:46.148252 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.138032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39118 (local address 127.26.52.126:44771)
0807 22:37:46.138217 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.138223 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.138474 (+ 251us) server_negotiation.cc:407] Connection header received
0807 22:37:46.138569 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.138572 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.138630 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.138757 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:46.139472 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.140620 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.141445 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.141891 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.142029 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.144508 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:46.144513 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:46.144516 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:46.144554 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:46.146469 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:46.146956 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:46.146959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:46.146961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:46.147049 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:46.147306 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:46.147309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:46.147311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:46.147545 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:46.147648 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.147930 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.148048 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:37:46.152897 28070 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:39118:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 22:37:46.153641 28070 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:37:46.158988 28229 tablet_service.cc:1467] Processing CreateTablet for tablet bd298aa0c4bd41b6bbbe6e8e559a2ef7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f1d6aa234d904e4885a0bd189c732156]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:37:46.159456 28229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd298aa0c4bd41b6bbbe6e8e559a2ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:46.159360 28383 tablet_service.cc:1467] Processing CreateTablet for tablet bd298aa0c4bd41b6bbbe6e8e559a2ef7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f1d6aa234d904e4885a0bd189c732156]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:37:46.159772 28383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd298aa0c4bd41b6bbbe6e8e559a2ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:46.159628 28537 tablet_service.cc:1467] Processing CreateTablet for tablet bd298aa0c4bd41b6bbbe6e8e559a2ef7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f1d6aa234d904e4885a0bd189c732156]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:37:46.160002 28537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd298aa0c4bd41b6bbbe6e8e559a2ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:46.163352 28633 tablet_bootstrap.cc:492] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: Bootstrap starting.
I20260807 22:37:46.165463 28633 tablet_bootstrap.cc:654] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:46.166535 28634 tablet_bootstrap.cc:492] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: Bootstrap starting.
I20260807 22:37:46.167466 28633 tablet_bootstrap.cc:492] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: No bootstrap required, opened a new log
I20260807 22:37:46.167591 28633 ts_tablet_manager.cc:1397] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260807 22:37:46.168316 28634 tablet_bootstrap.cc:654] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:46.168339 28633 raft_consensus.cc:348] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.168474 28633 raft_consensus.cc:374] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:46.168519 28633 raft_consensus.cc:729] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72eafec779974b68a8cc586d055244cb, State: Initialized, Role: FOLLOWER
I20260807 22:37:46.168666 28633 consensus_queue.cc:260] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.168998 28633 ts_tablet_manager.cc:1428] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 22:37:46.169529 28638 tablet_replica.cc:439] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } }
I20260807 22:37:46.169756 28638 tablet_replica.cc:442] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:46.169945 28635 tablet_bootstrap.cc:492] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: Bootstrap starting.
I20260807 22:37:46.171788 28635 tablet_bootstrap.cc:654] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:46.173044 28634 tablet_bootstrap.cc:492] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: No bootstrap required, opened a new log
I20260807 22:37:46.173164 28634 ts_tablet_manager.cc:1397] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260807 22:37:46.173924 28634 raft_consensus.cc:348] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.174075 28634 raft_consensus.cc:374] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:46.174113 28635 tablet_bootstrap.cc:492] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: No bootstrap required, opened a new log
I20260807 22:37:46.174120 28634 raft_consensus.cc:729] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17e92d3792ac4a7586e7b09d3859b9e6, State: Initialized, Role: FOLLOWER
I20260807 22:37:46.174221 28635 ts_tablet_manager.cc:1397] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.004s
I20260807 22:37:46.174304 28634 consensus_queue.cc:260] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.174696 28640 tablet_replica.cc:439] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } }
I20260807 22:37:46.174852 28640 tablet_replica.cc:442] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:46.175010 28635 raft_consensus.cc:348] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.175132 28634 ts_tablet_manager.cc:1428] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 22:37:46.175138 28635 raft_consensus.cc:374] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:46.175175 28635 raft_consensus.cc:729] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dfb7b30609429285b60d5b63725384, State: Initialized, Role: FOLLOWER
I20260807 22:37:46.175343 28635 consensus_queue.cc:260] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.175653 28635 ts_tablet_manager.cc:1428] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:37:46.175985 28644 tablet_replica.cc:439] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } }
I20260807 22:37:46.176216 28644 tablet_replica.cc:442] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:46.396311 28638 raft_consensus.cc:482] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:37:46.396502 28638 raft_consensus.cc:504] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.397691 28638 leader_election.cc:288] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17e92d3792ac4a7586e7b09d3859b9e6 (127.26.52.66:35355), a3dfb7b30609429285b60d5b63725384 (127.26.52.67:36373)
I20260807 22:37:46.402328 28631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.398022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:37689 (local address 127.26.52.67:36373)
0807 22:37:46.398209 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.398215 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.398821 (+ 606us) server_negotiation.cc:407] Connection header received
0807 22:37:46.398934 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.398940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.399000 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.399075 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:46.399367 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.399931 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.401218 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.401748 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.401839 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.401879 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.402085 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.402169 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 22:37:46.402362 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.397915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:36373 (local address 127.26.52.65:37689)
0807 22:37:46.398693 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:46.398706 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:46.398830 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:46.399104 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:46.399107 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:46.399126 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:46.399256 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.399262 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.400041 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.400046 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.401089 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.401099 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.401862 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.401865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.401954 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.401981 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:37:46.402063 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:37:46.402145 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":558,"threads_started":1}
I20260807 22:37:46.402730 28629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.398291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:50821 (local address 127.26.52.66:35355)
0807 22:37:46.398423 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.398427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.398983 (+ 556us) server_negotiation.cc:407] Connection header received
0807 22:37:46.399115 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.399118 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.399164 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.399243 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:46.399509 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.400002 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.401534 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.402083 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.402189 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.402234 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.402544 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.402629 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:37:46.402982 28558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd298aa0c4bd41b6bbbe6e8e559a2ef7" candidate_uuid: "72eafec779974b68a8cc586d055244cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dfb7b30609429285b60d5b63725384" is_pre_election: true
I20260807 22:37:46.403136 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.397915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:35355 (local address 127.26.52.65:50821)
0807 22:37:46.398842 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:46.398858 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:46.399003 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:46.399270 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:46.399272 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:46.399286 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:46.399398 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.399405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.400290 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.400293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.401407 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.401419 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.402274 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.402279 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.402375 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.402403 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 22:37:46.402882 (+ 479us) client_negotiation.cc:240] Negotiation successful
0807 22:37:46.402969 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":536,"threads_started":1}
I20260807 22:37:46.403146 28558 raft_consensus.cc:2454] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72eafec779974b68a8cc586d055244cb in term 0.
I20260807 22:37:46.403568 28174 leader_election.cc:302] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72eafec779974b68a8cc586d055244cb, a3dfb7b30609429285b60d5b63725384; no voters:
I20260807 22:37:46.403668 28407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd298aa0c4bd41b6bbbe6e8e559a2ef7" candidate_uuid: "72eafec779974b68a8cc586d055244cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" is_pre_election: true
I20260807 22:37:46.403836 28407 raft_consensus.cc:2454] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72eafec779974b68a8cc586d055244cb in term 0.
I20260807 22:37:46.403867 28638 raft_consensus.cc:2781] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:37:46.403945 28638 raft_consensus.cc:482] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:37:46.403995 28638 raft_consensus.cc:3037] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:46.405215 28638 raft_consensus.cc:504] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.405575 28638 leader_election.cc:288] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [CANDIDATE]: Term 1 election: Requested vote from peers 17e92d3792ac4a7586e7b09d3859b9e6 (127.26.52.66:35355), a3dfb7b30609429285b60d5b63725384 (127.26.52.67:36373)
I20260807 22:37:46.405925 28558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd298aa0c4bd41b6bbbe6e8e559a2ef7" candidate_uuid: "72eafec779974b68a8cc586d055244cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dfb7b30609429285b60d5b63725384"
I20260807 22:37:46.405905 28407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd298aa0c4bd41b6bbbe6e8e559a2ef7" candidate_uuid: "72eafec779974b68a8cc586d055244cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17e92d3792ac4a7586e7b09d3859b9e6"
I20260807 22:37:46.406047 28558 raft_consensus.cc:3037] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:46.406049 28407 raft_consensus.cc:3037] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:46.407053 28558 raft_consensus.cc:2454] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72eafec779974b68a8cc586d055244cb in term 1.
I20260807 22:37:46.407341 28174 leader_election.cc:302] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72eafec779974b68a8cc586d055244cb, a3dfb7b30609429285b60d5b63725384; no voters:
I20260807 22:37:46.407352 28407 raft_consensus.cc:2454] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72eafec779974b68a8cc586d055244cb in term 1.
I20260807 22:37:46.407526 28638 raft_consensus.cc:2781] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:46.407752 28638 raft_consensus.cc:686] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [term 1 LEADER]: Becoming Leader. State: Replica: 72eafec779974b68a8cc586d055244cb, State: Running, Role: LEADER
I20260807 22:37:46.408023 28638 consensus_queue.cc:237] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } }
I20260807 22:37:46.409436 28678 tablet_replica.cc:439] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: TxnStatusTablet state changed. Reason: New leader 72eafec779974b68a8cc586d055244cb. Latest consensus state: current_term: 1 leader_uuid: "72eafec779974b68a8cc586d055244cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } }
I20260807 22:37:46.409556 28678 tablet_replica.cc:442] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:37:46.409957 28681 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 22:37:46.410142 28681 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 22:37:46.410784 28071 catalog_manager.cc:5495] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 72eafec779974b68a8cc586d055244cb (127.26.52.65). New cstate: current_term: 1 leader_uuid: "72eafec779974b68a8cc586d055244cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } health_report { overall_health: UNKNOWN } } }
I20260807 22:37:46.463616 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.459695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41836 (local address 127.26.52.65:38979)
0807 22:37:46.459826 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.459831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.459943 (+ 112us) server_negotiation.cc:407] Connection header received
0807 22:37:46.460195 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.460198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.460263 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.460373 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:46.460636 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.461199 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.462081 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.462370 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.462480 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.462825 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:46.463201 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:46.463345 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.463421 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.463478 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:37:46.463615 28672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.459604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38979 (local address 127.0.0.1:41836)
0807 22:37:46.459848 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:46.459863 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:46.460011 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:46.460388 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:46.460391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:46.460399 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:37:46.460510 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.460517 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.461339 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.461343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.461956 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.461965 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.462481 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.462485 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.462610 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.462657 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:37:46.463312 (+ 655us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:37:46.463331 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 22:37:46.463400 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 22:37:46.463488 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260807 22:37:46.466575 28407 raft_consensus.cc:1261] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 FOLLOWER]: Refusing update from remote peer 72eafec779974b68a8cc586d055244cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:46.466908 28558 raft_consensus.cc:1261] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384 [term 1 FOLLOWER]: Refusing update from remote peer 72eafec779974b68a8cc586d055244cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:46.467504 28638 consensus_queue.cc:1035] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:46.468001 28678 consensus_queue.cc:1035] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:46.469781 28640 tablet_replica.cc:439] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: TxnStatusTablet state changed. Reason: New leader 72eafec779974b68a8cc586d055244cb. Latest consensus state: current_term: 1 leader_uuid: "72eafec779974b68a8cc586d055244cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } }
I20260807 22:37:46.469914 28640 tablet_replica.cc:442] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:46.470767 28644 tablet_replica.cc:439] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: TxnStatusTablet state changed. Reason: New leader 72eafec779974b68a8cc586d055244cb. Latest consensus state: current_term: 1 leader_uuid: "72eafec779974b68a8cc586d055244cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } }
I20260807 22:37:46.470885 28644 tablet_replica.cc:442] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:46.472067 28638 tablet_replica.cc:439] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "72eafec779974b68a8cc586d055244cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } }
I20260807 22:37:46.473280 28638 tablet_replica.cc:442] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:37:46.473500 28640 tablet_replica.cc:439] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "72eafec779974b68a8cc586d055244cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } }
I20260807 22:37:46.473685 28640 tablet_replica.cc:442] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 17e92d3792ac4a7586e7b09d3859b9e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:46.476976 28638 tablet_replica.cc:439] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "72eafec779974b68a8cc586d055244cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } }
I20260807 22:37:46.477077 28638 tablet_replica.cc:442] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P 72eafec779974b68a8cc586d055244cb: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:37:46.478962 28644 tablet_replica.cc:439] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "72eafec779974b68a8cc586d055244cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 } } peers { permanent_uuid: "17e92d3792ac4a7586e7b09d3859b9e6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 35355 } } peers { permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 } } }
I20260807 22:37:46.479091 28644 tablet_replica.cc:442] T bd298aa0c4bd41b6bbbe6e8e559a2ef7 P a3dfb7b30609429285b60d5b63725384: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:46.483422 28629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.478740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53374 (local address 127.26.52.66:35355)
0807 22:37:46.478860 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.478865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.479738 (+ 873us) server_negotiation.cc:407] Connection header received
0807 22:37:46.479935 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.479939 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.480008 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.480149 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:46.480588 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.481118 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.482001 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.482233 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.482346 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.482649 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:46.483044 (+ 395us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:46.483170 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.483229 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.483286 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:37:46.494729 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.490806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:56223 (local address 127.26.52.65:38979)
0807 22:37:46.490934 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.490939 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.491174 (+ 235us) server_negotiation.cc:407] Connection header received
0807 22:37:46.491326 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.491328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.491365 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.491424 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:46.491673 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.492198 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.493631 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.493917 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.493998 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.494356 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:46.494412 (+ 56us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:46.494464 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.494602 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.494639 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:37:46.494874 28691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.490709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38979 (local address 127.26.52.66:56223)
0807 22:37:46.491068 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:46.491086 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:46.491233 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:46.491459 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:46.491463 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:46.491471 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:37:46.491577 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.491583 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.492313 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.492317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.493495 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.493507 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.494056 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.494061 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.494155 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.494218 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:37:46.494500 (+ 282us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:37:46.494506 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:37:46.494581 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 22:37:46.494661 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":153,"threads_started":1}
I20260807 22:37:46.501761 28558 raft_consensus.cc:1261] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384 [term 1 FOLLOWER]: Refusing update from remote peer 17e92d3792ac4a7586e7b09d3859b9e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:46.501816 28252 raft_consensus.cc:1261] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb [term 1 FOLLOWER]: Refusing update from remote peer 17e92d3792ac4a7586e7b09d3859b9e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:46.502295 28665 consensus_queue.cc:1035] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72eafec779974b68a8cc586d055244cb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:46.502485 28640 consensus_queue.cc:1035] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dfb7b30609429285b60d5b63725384" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:46.528685 28697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.522350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:35355 (local address 127.26.52.65:52723)
0807 22:37:46.523243 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:46.523260 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:46.523542 (+ 282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:46.524101 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:46.524107 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:46.524137 (+ 30us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:37:46.524841 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.524849 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.525702 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.525708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.527132 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:46.527142 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.527829 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.527835 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:46.527998 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.528045 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:37:46.528448 (+ 403us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:37:46.528453 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:37:46.528503 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 22:37:46.528565 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":174,"threads_started":1}
I20260807 22:37:46.528721 28629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.522427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:52723 (local address 127.26.52.66:35355)
0807 22:37:46.522580 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.522586 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.523333 (+ 747us) server_negotiation.cc:407] Connection header received
0807 22:37:46.523704 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.523707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.523761 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.523862 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:46.524961 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.525587 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.527280 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.527619 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.527720 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.528220 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:46.528315 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:46.528452 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.528521 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.528581 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:37:46.558935 28070 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:46.559140 28070 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:46.562170 28070 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 790ce382a52a423ca02069c8397ecf22: Sending DeleteTablet for 3 replicas of tablet 6179af3e5e83427bb9c27c2eb47271b2
I20260807 22:37:46.563094 28229 tablet_service.cc:1514] Processing DeleteTablet for tablet 6179af3e5e83427bb9c27c2eb47271b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:46 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:41834
I20260807 22:37:46.563311 28537 tablet_service.cc:1514] Processing DeleteTablet for tablet 6179af3e5e83427bb9c27c2eb47271b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:46 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:41538
I20260807 22:37:46.564178 28383 tablet_service.cc:1514] Processing DeleteTablet for tablet 6179af3e5e83427bb9c27c2eb47271b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:46 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:53364
I20260807 22:37:46.565785 28702 tablet_replica.cc:330] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6: stopping tablet replica
I20260807 22:37:46.565975 28702 raft_consensus.cc:2229] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:37:46.566560 28702 raft_consensus.cc:2258] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:46.567612 28702 ts_tablet_manager.cc:1905] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:46.572551 28701 tablet_replica.cc:330] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384: stopping tablet replica
I20260807 22:37:46.572745 28701 raft_consensus.cc:2229] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:46.572938 28701 raft_consensus.cc:2258] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:46.573880 28701 ts_tablet_manager.cc:1905] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:46.573988 28702 ts_tablet_manager.cc:1918] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:37:46.574074 28702 log.cc:1196] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/6179af3e5e83427bb9c27c2eb47271b2
I20260807 22:37:46.574410 28702 ts_tablet_manager.cc:1939] T 6179af3e5e83427bb9c27c2eb47271b2 P 17e92d3792ac4a7586e7b09d3859b9e6: Deleting consensus metadata
I20260807 22:37:46.575203 28057 catalog_manager.cc:4841] TS 17e92d3792ac4a7586e7b09d3859b9e6 (127.26.52.66:35355): tablet 6179af3e5e83427bb9c27c2eb47271b2 (table test-table [id=ec5d0763f9a6406d9a4a19bd2468e04f]) successfully deleted
Aug 07 22:37:46 dist-test-slave-8w9v krb5kdc[28023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142265, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:37:46.572388 28700 tablet_replica.cc:330] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb: stopping tablet replica
I20260807 22:37:46.576493 28700 raft_consensus.cc:2229] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:46.576632 28700 raft_consensus.cc:2258] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:46.577348 28700 ts_tablet_manager.cc:1905] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:46.577867 28701 ts_tablet_manager.cc:1918] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:37:46.578035 28701 log.cc:1196] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/6179af3e5e83427bb9c27c2eb47271b2
I20260807 22:37:46.578408 28701 ts_tablet_manager.cc:1939] T 6179af3e5e83427bb9c27c2eb47271b2 P a3dfb7b30609429285b60d5b63725384: Deleting consensus metadata
I20260807 22:37:46.579413 28059 catalog_manager.cc:4841] TS a3dfb7b30609429285b60d5b63725384 (127.26.52.67:36373): tablet 6179af3e5e83427bb9c27c2eb47271b2 (table test-table [id=ec5d0763f9a6406d9a4a19bd2468e04f]) successfully deleted
I20260807 22:37:46.581283 28700 ts_tablet_manager.cc:1918] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:37:46.581429 28700 log.cc:1196] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/6179af3e5e83427bb9c27c2eb47271b2
I20260807 22:37:46.581867 28700 ts_tablet_manager.cc:1939] T 6179af3e5e83427bb9c27c2eb47271b2 P 72eafec779974b68a8cc586d055244cb: Deleting consensus metadata
I20260807 22:37:46.582600 28056 catalog_manager.cc:4841] TS 72eafec779974b68a8cc586d055244cb (127.26.52.65:38979): tablet 6179af3e5e83427bb9c27c2eb47271b2 (table test-table [id=ec5d0763f9a6406d9a4a19bd2468e04f]) successfully deleted
I20260807 22:37:46.583766 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.565835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41840 (local address 127.26.52.65:38979)
0807 22:37:46.565978 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.566000 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.567062 (+ 1062us) server_negotiation.cc:407] Connection header received
0807 22:37:46.567267 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.567271 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.567350 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.567408 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:46.569022 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.569876 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.571282 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.571702 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.571796 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.577592 (+ 5796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:46.577601 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:46.577616 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:46.577643 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:46.580242 (+ 2599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:46.581220 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:46.581228 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:46.581230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:46.581458 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:46.581935 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:46.581942 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:46.581944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:46.582485 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:46.582769 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.583408 (+ 639us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.583552 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 22:37:46.585831 28297 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41840
I20260807 22:37:46.598942 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:46.588177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39134 (local address 127.26.52.126:44771)
0807 22:37:46.588365 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:46.588370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:46.588519 (+ 149us) server_negotiation.cc:407] Connection header received
0807 22:37:46.588633 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:46.588636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:46.588707 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:46.588851 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:46.589756 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.590583 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.591781 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:46.592380 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:46.592569 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:46.594555 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:46.594560 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:46.594566 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:46.594599 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:46.596766 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:46.597254 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:46.597258 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:46.597261 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:46.597360 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:46.597789 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:46.597793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:46.597795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:46.598043 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:46.598207 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:46.598595 (+ 388us) server_negotiation.cc:299] Negotiation successful
0807 22:37:46.598763 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260807 22:37:46.600248 28070 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39134
I20260807 22:37:46.602114 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 28153
I20260807 22:37:46.614807 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 28315
I20260807 22:37:46.625967 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 28466
I20260807 22:37:46.633841 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 28039
2026-08-07T22:37:46Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3091 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:37:46 dist-test-slave-8w9v krb5kdc[28710](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:37:46 dist-test-slave-8w9v krb5kdc[28710](info): set up 2 sockets
Aug 07 22:37:46 dist-test-slave-8w9v krb5kdc[28710](info): commencing operation
krb5kdc: starting...
W20260807 22:37:47.714546 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:37:47 dist-test-slave-8w9v krb5kdc[28710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:37:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:37:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:37:47.838985 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:43161
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:38617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:43161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:47.952080 28724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:47.952402 28724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:47.952447 28724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:47.956569 28724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:37:47.956629 28724 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 22:37:47.956650 28724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:47.956671 28724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:47.956691 28724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:37:47.956717 28724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:37:47.962003 28724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:38617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:43161
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:43161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:47.963044 28724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:47.964075 28724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:47.972952 28733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:47.972944 28731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:47.972994 28724 server_base.cc:1034] running on GCE node
W20260807 22:37:47.972945 28730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:47.973685 28724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:47.974861 28724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:47.976052 28724 hybrid_clock.cc:648] HybridClock initialized: now 1786142267976034 us; error 29 us; skew 500 ppm
Aug 07 22:37:47 dist-test-slave-8w9v krb5kdc[28710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142267, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:47.978758 28724 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:37:47.979660 28724 webserver.cc:460] Webserver started at http://127.26.52.126:42927/ using document root <none> and password file <none>
I20260807 22:37:47.980278 28724 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:47.980368 28724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:47.980612 28724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:47.982605 28724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "4620be73be74452696bfcb4bf80efa84"
format_stamp: "Formatted at 2026-08-07 22:37:47 on dist-test-slave-8w9v"
server_key: "52ecb7193d8b8cb4dda77a3bd5a5ddb9"
server_key_iv: "f73ed3e9ce69e519c393e8617bf11f7e"
server_key_version: "encryptionkey@0"
I20260807 22:37:47.983172 28724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "4620be73be74452696bfcb4bf80efa84"
format_stamp: "Formatted at 2026-08-07 22:37:47 on dist-test-slave-8w9v"
server_key: "52ecb7193d8b8cb4dda77a3bd5a5ddb9"
server_key_iv: "f73ed3e9ce69e519c393e8617bf11f7e"
server_key_version: "encryptionkey@0"
I20260807 22:37:47.986976 28724 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260807 22:37:47.989432 28741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:47.990584 28724 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:37:47.990726 28724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "4620be73be74452696bfcb4bf80efa84"
format_stamp: "Formatted at 2026-08-07 22:37:47 on dist-test-slave-8w9v"
server_key: "52ecb7193d8b8cb4dda77a3bd5a5ddb9"
server_key_iv: "f73ed3e9ce69e519c393e8617bf11f7e"
server_key_version: "encryptionkey@0"
I20260807 22:37:47.990844 28724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:48.004669 28724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:48.008000 28724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:48.008267 28724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:48.016341 28724 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:43161
I20260807 22:37:48.016371 28808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:43161 every 8 connection(s)
I20260807 22:37:48.017299 28724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:37:48.020046 28809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:48.025626 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 28724
I20260807 22:37:48.025765 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:37:48.025884 28809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84: Bootstrap starting.
I20260807 22:37:48.026105 26833 external_mini_cluster.cc:1428] Setting key 78c69d3317a1a69ef78d5011ff8ff793
I20260807 22:37:48.028648 28809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:48.029449 28809 log.cc:824] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:48.031327 28809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84: No bootstrap required, opened a new log
Aug 07 22:37:48 dist-test-slave-8w9v krb5kdc[28710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:48.036087 28809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4620be73be74452696bfcb4bf80efa84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43161 } }
I20260807 22:37:48.036439 28809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:48.036526 28809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4620be73be74452696bfcb4bf80efa84, State: Initialized, Role: FOLLOWER
I20260807 22:37:48.036948 28809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4620be73be74452696bfcb4bf80efa84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43161 } }
I20260807 22:37:48.037101 28809 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:37:48.037184 28809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:37:48.037302 28809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:48.038493 28809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4620be73be74452696bfcb4bf80efa84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43161 } }
I20260807 22:37:48.038831 28809 leader_election.cc:302] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4620be73be74452696bfcb4bf80efa84; no voters:
I20260807 22:37:48.039178 28809 leader_election.cc:288] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:37:48.039256 28814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:48.039482 28814 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [term 1 LEADER]: Becoming Leader. State: Replica: 4620be73be74452696bfcb4bf80efa84, State: Running, Role: LEADER
I20260807 22:37:48.039777 28814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4620be73be74452696bfcb4bf80efa84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43161 } }
I20260807 22:37:48.040561 28809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:37:48.041484 28815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4620be73be74452696bfcb4bf80efa84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4620be73be74452696bfcb4bf80efa84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43161 } } }
I20260807 22:37:48.041674 28815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:48.041993 28816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4620be73be74452696bfcb4bf80efa84. Latest consensus state: current_term: 1 leader_uuid: "4620be73be74452696bfcb4bf80efa84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4620be73be74452696bfcb4bf80efa84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43161 } } }
I20260807 22:37:48.042088 28816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84 [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:48.042196 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.027565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35168 (local address 127.26.52.126:43161)
0807 22:37:48.028032 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.028047 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.028081 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:37:48.028871 (+ 790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.028889 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.029210 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.029572 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:48.030426 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.031380 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.032560 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.033024 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.033140 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.035954 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:48.035971 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:48.035986 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:48.036034 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:48.038266 (+ 2232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.038722 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.038728 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.038734 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.038857 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.039162 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.039166 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.039167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.039784 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:48.040621 (+ 837us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.040810 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.041127 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":149,"threads_started":1}
I20260807 22:37:48.042387 28823 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:37:48.045722 28823 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:37:48.051100 28823 catalog_manager.cc:1347] Generated new cluster ID: 93360490d96b41ce9508ed2905fd1c1d
I20260807 22:37:48.051168 28823 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:37:48.065858 28823 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:37:48.066800 28823 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:37:48.070312 28823 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84: Generated new TSK 0
I20260807 22:37:48.070995 28823 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:37:48.102872 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:43161
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:38617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:48.231231 28838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:48.231469 28838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:48.231513 28838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:48.235129 28838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:48.235186 28838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:48.235222 28838 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 22:37:48.235235 28838 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:37:48.235265 28838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:37:48.240265 28838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:38617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.52.126:43161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:48.241264 28838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:48.242282 28838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:48.251998 28846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:48.251978 28843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:48.252195 28838 server_base.cc:1034] running on GCE node
W20260807 22:37:48.252054 28844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:48.252640 28838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:48.253228 28838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:48.254415 28838 hybrid_clock.cc:648] HybridClock initialized: now 1786142268254380 us; error 47 us; skew 500 ppm
Aug 07 22:37:48 dist-test-slave-8w9v krb5kdc[28710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142268, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:48.257158 28838 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:37:48.258033 28838 webserver.cc:460] Webserver started at http://127.26.52.65:33171/ using document root <none> and password file <none>
I20260807 22:37:48.258610 28838 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:48.258701 28838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:48.258948 28838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:48.261178 28838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3"
format_stamp: "Formatted at 2026-08-07 22:37:48 on dist-test-slave-8w9v"
server_key: "ba43d3f48509fa1114c1b076b49c404b"
server_key_iv: "d276d49240c4bad6193944aafe05dc9a"
server_key_version: "encryptionkey@0"
I20260807 22:37:48.261739 28838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3"
format_stamp: "Formatted at 2026-08-07 22:37:48 on dist-test-slave-8w9v"
server_key: "ba43d3f48509fa1114c1b076b49c404b"
server_key_iv: "d276d49240c4bad6193944aafe05dc9a"
server_key_version: "encryptionkey@0"
I20260807 22:37:48.265424 28838 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:37:48.267752 28853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:48.269007 28838 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:37:48.269151 28838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3"
format_stamp: "Formatted at 2026-08-07 22:37:48 on dist-test-slave-8w9v"
server_key: "ba43d3f48509fa1114c1b076b49c404b"
server_key_iv: "d276d49240c4bad6193944aafe05dc9a"
server_key_version: "encryptionkey@0"
I20260807 22:37:48.269263 28838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:48.292331 28838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:48.295480 28838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:48.295678 28838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:48.297226 28838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:48.297302 28838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:48.297369 28838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:48.297416 28838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:37:48 dist-test-slave-8w9v krb5kdc[28710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142268, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:48.308109 28838 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:40195
I20260807 22:37:48.308305 28980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:40195 every 8 connection(s)
I20260807 22:37:48.309156 28838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:37:48.311134 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 28838
I20260807 22:37:48.311257 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:37:48.311513 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.298136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:38075 (local address 127.26.52.126:43161)
0807 22:37:48.298290 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.298295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.299134 (+ 839us) server_negotiation.cc:407] Connection header received
0807 22:37:48.300213 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.300219 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.300285 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.300401 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:48.301891 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.302802 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.304307 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.304780 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.304918 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.307497 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:48.307502 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:48.307504 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:48.307537 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:48.309212 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.309885 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.309890 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.309894 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.309996 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.310323 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.310327 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.310329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.310520 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:48.310646 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.311179 (+ 533us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.311351 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 22:37:48.311599 26833 external_mini_cluster.cc:1428] Setting key 9069f9deaf23d03b3eeb9a5c9eb66a61
I20260807 22:37:48.312464 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.298518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:43161 (local address 127.26.52.65:38075)
0807 22:37:48.298957 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:48.299005 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:48.299962 (+ 957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:48.300739 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:48.300752 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:48.301116 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:48.301722 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.301753 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.302964 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.302968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.304114 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.304178 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.304982 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.304988 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.305175 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.305799 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:48.305843 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:48.307304 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:48.309340 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.309346 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.309359 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.309732 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.310079 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.310083 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.310085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.310218 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.310645 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:48.310651 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:48.310913 (+ 262us) client_negotiation.cc:769] Sending connection context
0807 22:37:48.311132 (+ 219us) client_negotiation.cc:240] Negotiation successful
0807 22:37:48.311477 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":120,"threads_started":1}
I20260807 22:37:48.313835 28981 heartbeater.cc:347] Connected to a master server at 127.26.52.126:43161
I20260807 22:37:48.314002 28981 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:48.314558 28981 heartbeater.cc:511] Master 127.26.52.126:43161 requested a full tablet report, sending...
I20260807 22:37:48.316221 28759 ts_manager.cc:194] Registered new tserver with Master: b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195)
I20260807 22:37:48.317373 28759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:38075
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:37:48.327966 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.316104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:36707 (local address 127.26.52.126:43161)
0807 22:37:48.316250 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.316254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.321132 (+ 4878us) server_negotiation.cc:407] Connection header received
0807 22:37:48.321272 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.321275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.321325 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.321410 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:48.321838 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.322332 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.323141 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.323391 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.323513 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.324718 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:48.324721 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:48.324724 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:48.324748 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:48.326301 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.326724 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.326732 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.326733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.326802 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.327090 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.327093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.327095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.327261 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:48.327381 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.327741 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.327836 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 22:37:48.328230 28988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.316026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:43161 (local address 127.26.52.65:36707)
0807 22:37:48.321038 (+ 5012us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:48.321051 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:48.321178 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:48.321439 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:48.321442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:48.321632 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:48.321723 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.321729 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.322473 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.322476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.323022 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.323029 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.323520 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.323524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.323622 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.324186 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:48.324203 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:48.324582 (+ 379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:48.326412 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.326417 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.326419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.326616 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.326902 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.326905 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.326907 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.326991 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.327437 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:48.327441 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:48.327550 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 22:37:48.327667 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 22:37:48.327823 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4936,"thread_start_us":114,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:37:48.342767 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:43161
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:38617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:48.455978 28991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:48.456295 28991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:48.456387 28991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:48.460457 28991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:48.460527 28991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:48.460590 28991 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 22:37:48.460631 28991 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:37:48.460700 28991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:37:48.465852 28991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:38617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.52.126:43161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:48.466842 28991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:48.467854 28991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:48.477232 28999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:48.477248 28997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:48.477241 28996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:48.477499 28991 server_base.cc:1034] running on GCE node
I20260807 22:37:48.477988 28991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:48.478595 28991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:48.479781 28991 hybrid_clock.cc:648] HybridClock initialized: now 1786142268479762 us; error 27 us; skew 500 ppm
Aug 07 22:37:48 dist-test-slave-8w9v krb5kdc[28710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142268, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:48.482430 28991 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:37:48.483235 28991 webserver.cc:460] Webserver started at http://127.26.52.66:46117/ using document root <none> and password file <none>
I20260807 22:37:48.483726 28991 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:48.483780 28991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:48.483932 28991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:48.485877 28991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "9924b49d7b144d88b5884d45ea5035a7"
format_stamp: "Formatted at 2026-08-07 22:37:48 on dist-test-slave-8w9v"
server_key: "256e8615c70f4a78eef71d36bf584a1f"
server_key_iv: "d9f55364d044e382cb05c06fbe780f14"
server_key_version: "encryptionkey@0"
I20260807 22:37:48.486414 28991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "9924b49d7b144d88b5884d45ea5035a7"
format_stamp: "Formatted at 2026-08-07 22:37:48 on dist-test-slave-8w9v"
server_key: "256e8615c70f4a78eef71d36bf584a1f"
server_key_iv: "d9f55364d044e382cb05c06fbe780f14"
server_key_version: "encryptionkey@0"
I20260807 22:37:48.489971 28991 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:37:48.492188 29008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:48.493294 28991 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:48.493381 28991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "9924b49d7b144d88b5884d45ea5035a7"
format_stamp: "Formatted at 2026-08-07 22:37:48 on dist-test-slave-8w9v"
server_key: "256e8615c70f4a78eef71d36bf584a1f"
server_key_iv: "d9f55364d044e382cb05c06fbe780f14"
server_key_version: "encryptionkey@0"
I20260807 22:37:48.493482 28991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:48.513510 28991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:48.516549 28991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:48.516705 28991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:48.518059 28991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:48.518105 28991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:48.518170 28991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:48.518201 28991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:37:48 dist-test-slave-8w9v krb5kdc[28710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142268, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:48.528741 28991 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:34553
I20260807 22:37:48.528798 29136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:34553 every 8 connection(s)
I20260807 22:37:48.529824 28991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:37:48.532775 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.518932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:43761 (local address 127.26.52.126:43161)
0807 22:37:48.519059 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.519062 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.520069 (+ 1007us) server_negotiation.cc:407] Connection header received
0807 22:37:48.521301 (+ 1232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.521307 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.521377 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.521493 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:48.523018 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.523952 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.525737 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.526098 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.526222 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.529273 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:48.529276 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:48.529279 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:48.529309 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:48.530843 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.531411 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.531413 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.531415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.531497 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.531784 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.531786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.531787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.531957 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:48.532029 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.532562 (+ 533us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.532655 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:37:48.533531 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.519439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:43161 (local address 127.26.52.66:43761)
0807 22:37:48.519923 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:48.519963 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:48.521009 (+ 1046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:48.521698 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:48.521709 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:48.522131 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:48.522834 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.522857 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.524097 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.524103 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.525608 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.525625 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.526250 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.526252 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.526400 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.527117 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:48.527139 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:48.529102 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:48.530948 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.530954 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.530967 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.531309 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.531573 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.531575 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.531577 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.531699 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.532041 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:48.532046 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:48.532323 (+ 277us) client_negotiation.cc:769] Sending connection context
0807 22:37:48.532483 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 22:37:48.532721 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":144,"threads_started":1}
I20260807 22:37:48.534744 29137 heartbeater.cc:347] Connected to a master server at 127.26.52.126:43161
I20260807 22:37:48.534902 29137 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:48.535375 29137 heartbeater.cc:511] Master 127.26.52.126:43161 requested a full tablet report, sending...
I20260807 22:37:48.536495 28760 ts_manager.cc:194] Registered new tserver with Master: 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553)
I20260807 22:37:48.537246 28760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:43761
I20260807 22:37:48.539740 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 28991
I20260807 22:37:48.539875 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:37:48.540210 26833 external_mini_cluster.cc:1428] Setting key 0f44ac3fed256052c4dd371c95726035
I20260807 22:37:48.544653 29144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.536866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:43161 (local address 127.26.52.66:50023)
0807 22:37:48.537655 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:48.537668 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:48.537783 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:48.538029 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:48.538032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:48.538217 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:48.538334 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.538340 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.539060 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.539063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.539597 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.539605 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.540156 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.540159 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.540251 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.540786 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:48.540800 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:48.541169 (+ 369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:48.543023 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.543029 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.543034 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.543313 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.543625 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.543631 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.543635 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.543730 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.544266 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:48.544268 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:48.544340 (+ 72us) client_negotiation.cc:769] Sending connection context
0807 22:37:48.544428 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:37:48.544529 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"thread_start_us":129,"threads_started":1}
I20260807 22:37:48.544827 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.536958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:50023 (local address 127.26.52.126:43161)
0807 22:37:48.537070 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.537073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.537734 (+ 661us) server_negotiation.cc:407] Connection header received
0807 22:37:48.537877 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.537880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.537930 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.538011 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:48.538455 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.538935 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.539711 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.540005 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.540125 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.541302 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:48.541305 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:48.541309 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:48.541347 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:48.542909 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.543404 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.543406 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.543408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.543516 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.543818 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.543823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.543826 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.544142 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:48.544269 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.544513 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.544635 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:37:48.568518 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:43161
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:38617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:48.679718 29147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:48.679958 29147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:48.680006 29147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:48.683897 29147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:48.683947 29147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:48.683986 29147 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 22:37:48.684000 29147 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:37:48.684031 29147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:37:48.689175 29147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:38617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.52.126:43161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:48.690119 29147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:48.691073 29147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:48.700663 29152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:48.700683 29153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:48.700721 29155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:48.700948 29147 server_base.cc:1034] running on GCE node
I20260807 22:37:48.701371 29147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:48.701969 29147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:48.703153 29147 hybrid_clock.cc:648] HybridClock initialized: now 1786142268703138 us; error 26 us; skew 500 ppm
Aug 07 22:37:48 dist-test-slave-8w9v krb5kdc[28710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142268, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:48.705902 29147 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:37:48.706787 29147 webserver.cc:460] Webserver started at http://127.26.52.67:36077/ using document root <none> and password file <none>
I20260807 22:37:48.707350 29147 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:48.707410 29147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:48.707662 29147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:48.709717 29147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "d5d55fbfee394a7b929655294c10229a"
format_stamp: "Formatted at 2026-08-07 22:37:48 on dist-test-slave-8w9v"
server_key: "3b78f7b77dbe64dc48a965307e495ad4"
server_key_iv: "bd5b4fcba994b289e0a9066f4cd005b0"
server_key_version: "encryptionkey@0"
I20260807 22:37:48.710281 29147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "d5d55fbfee394a7b929655294c10229a"
format_stamp: "Formatted at 2026-08-07 22:37:48 on dist-test-slave-8w9v"
server_key: "3b78f7b77dbe64dc48a965307e495ad4"
server_key_iv: "bd5b4fcba994b289e0a9066f4cd005b0"
server_key_version: "encryptionkey@0"
I20260807 22:37:48.714051 29147 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:37:48.716511 29162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:48.717672 29147 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:48.717809 29147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "d5d55fbfee394a7b929655294c10229a"
format_stamp: "Formatted at 2026-08-07 22:37:48 on dist-test-slave-8w9v"
server_key: "3b78f7b77dbe64dc48a965307e495ad4"
server_key_iv: "bd5b4fcba994b289e0a9066f4cd005b0"
server_key_version: "encryptionkey@0"
I20260807 22:37:48.717938 29147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:48.728982 29147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:48.732224 29147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:48.732416 29147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:48.733935 29147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:48.734005 29147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:48.734079 29147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:48.734112 29147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:37:48 dist-test-slave-8w9v krb5kdc[28710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142268, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:48.745522 29147 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:36211
I20260807 22:37:48.745648 29290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:36211 every 8 connection(s)
I20260807 22:37:48.746419 29147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:37:48.748106 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.734689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:56233 (local address 127.26.52.126:43161)
0807 22:37:48.734873 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.734881 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.736262 (+ 1381us) server_negotiation.cc:407] Connection header received
0807 22:37:48.737373 (+ 1111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.737377 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.737448 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.737535 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:48.739166 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.739809 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.741271 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.741634 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.741771 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.744494 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:48.744499 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:48.744506 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:48.744529 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:48.746133 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.746673 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.746676 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.746678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.746763 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.747107 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.747110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.747112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.747334 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:48.747455 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.747886 (+ 431us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.747984 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:37:48.748893 29173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.735608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:43161 (local address 127.26.52.67:56233)
0807 22:37:48.736076 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:48.736148 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:48.737155 (+ 1007us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:48.737749 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:48.737758 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:48.738255 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:48.738980 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.739004 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.739959 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.739962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.741140 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.741151 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.741819 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.741823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.742004 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.742589 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:48.742604 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:48.744314 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:48.746261 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.746266 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.746280 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.746557 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.746856 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.746859 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.746862 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.747001 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.747457 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:48.747463 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:48.747674 (+ 211us) client_negotiation.cc:769] Sending connection context
0807 22:37:48.747822 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 22:37:48.748055 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":123,"threads_started":1}
I20260807 22:37:48.750067 29293 heartbeater.cc:347] Connected to a master server at 127.26.52.126:43161
I20260807 22:37:48.750231 29293 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:48.750738 29293 heartbeater.cc:511] Master 127.26.52.126:43161 requested a full tablet report, sending...
I20260807 22:37:48.751802 28759 ts_manager.cc:194] Registered new tserver with Master: d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211)
I20260807 22:37:48.752635 28759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:56233
I20260807 22:37:48.754817 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 29147
I20260807 22:37:48.754949 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:37:48.755255 26833 external_mini_cluster.cc:1428] Setting key 1152dd9d57944ef662834f1a546370fe
I20260807 22:37:48.757561 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:37:48.759529 29299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.752070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:43161 (local address 127.26.52.67:53371)
0807 22:37:48.752393 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:48.752407 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:48.752487 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:48.753071 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:48.753074 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:48.753262 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:48.753366 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.753372 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.754106 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.754109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.754645 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.754653 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.755190 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.755194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.755287 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.755853 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:48.755865 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:48.756274 (+ 409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:48.758097 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.758100 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.758102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.758286 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.758603 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:48.758606 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:48.758608 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:48.758697 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:48.759135 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:48.759137 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:48.759211 (+ 74us) client_negotiation.cc:769] Sending connection context
0807 22:37:48.759290 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 22:37:48.759391 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":120,"threads_started":1}
I20260807 22:37:48.759742 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.752219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:53371 (local address 127.26.52.126:43161)
0807 22:37:48.752892 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.752895 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.752906 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:37:48.752932 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.752934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.752961 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.753053 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:48.753486 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.753973 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.754764 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.755071 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.755186 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.756399 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:48.756403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:48.756405 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:48.756437 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:48.757991 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.758385 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.758391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.758395 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.758498 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.758789 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.758795 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.758800 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.759040 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:48.759146 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.759376 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.759512 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619}
Aug 07 22:37:48 dist-test-slave-8w9v krb5kdc[28710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:37:48 dist-test-slave-8w9v krb5kdc[28710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:48.785051 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.776918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35170 (local address 127.26.52.126:43161)
0807 22:37:48.777058 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.777062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.777074 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:37:48.777111 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.777113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.777149 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.777244 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:48.777950 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.778461 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.779295 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.779512 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.779618 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.782100 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:48.782103 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:48.782105 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:48.782128 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:48.783282 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.783692 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.783696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.783698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.783796 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:48.784075 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:48.784078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:48.784080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:48.784361 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:48.784501 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.784751 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.784872 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:37:48.787860 28759 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:37:48.790915 28759 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:37:48.805403 29314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.799127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:36211 (local address 127.0.0.1:39790)
0807 22:37:48.799996 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:48.800044 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:48.800189 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:48.800700 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:48.800708 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:48.800737 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:48.800884 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.800890 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.802346 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.802352 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.803759 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.803769 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.804804 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.804808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.804935 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.804980 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 22:37:48.805105 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 22:37:48.805236 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"mutex_wait_us":250,"thread_start_us":78,"threads_started":1}
I20260807 22:37:48.805411 29315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.799714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39790 (local address 127.26.52.67:36211)
0807 22:37:48.800189 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.800202 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.800227 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:37:48.800317 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.800322 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.800526 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.800693 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:48.801003 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.802216 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.803888 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.804664 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.804783 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.804964 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.805140 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.805250 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":101,"threads_started":1}
I20260807 22:37:48.805747 29313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.799274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46028 (local address 127.26.52.66:34553)
0807 22:37:48.800502 (+ 1228us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.800515 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.800768 (+ 253us) server_negotiation.cc:407] Connection header received
0807 22:37:48.800845 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.800850 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.801012 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.801161 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:48.801394 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.802531 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.804168 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.804701 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.804828 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.804993 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.805481 (+ 488us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.805599 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1100,"thread_start_us":174,"threads_started":1}
I20260807 22:37:48.805403 29311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.799127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:34553 (local address 127.0.0.1:46028)
0807 22:37:48.800579 (+ 1452us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:48.800595 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:48.800677 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:48.801148 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:48.801151 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:48.801169 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:48.801260 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.801266 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.802656 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.802662 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.803999 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.804011 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.805058 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.805061 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.805149 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.805169 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 22:37:48.805233 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 22:37:48.805284 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1387,"mutex_wait_us":196,"thread_start_us":118,"threads_started":1}
I20260807 22:37:48.806126 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.799980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47084 (local address 127.26.52.65:40195)
0807 22:37:48.800448 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:48.800461 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:48.800759 (+ 298us) server_negotiation.cc:407] Connection header received
0807 22:37:48.800946 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:48.800951 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:48.801100 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:48.801222 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:48.801561 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.802309 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.804161 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.804912 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.805018 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.805194 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:48.805798 (+ 604us) server_negotiation.cc:299] Negotiation successful
0807 22:37:48.805982 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":89,"threads_started":1}
I20260807 22:37:48.806506 29312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:48.799329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40195 (local address 127.0.0.1:47084)
0807 22:37:48.800666 (+ 1337us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:48.800679 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:48.800817 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:48.801311 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:48.801315 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:48.801334 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:48.801432 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.801437 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.802424 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.802428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.804002 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:48.804011 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:48.805257 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:48.805261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:48.805359 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:48.805383 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:37:48.805472 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 22:37:48.806357 (+ 885us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1254,"mutex_wait_us":97,"thread_start_us":136,"threads_started":1}
I20260807 22:37:48.808770 28909 tablet_service.cc:1467] Processing CreateTablet for tablet 70b42650f8a442e1aeb4be9f50b7f86e (DEFAULT_TABLE table=test-table [id=2f32528e6df344c6a8e770fceef44dfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:48.808734 29221 tablet_service.cc:1467] Processing CreateTablet for tablet 70b42650f8a442e1aeb4be9f50b7f86e (DEFAULT_TABLE table=test-table [id=2f32528e6df344c6a8e770fceef44dfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:48.808734 29066 tablet_service.cc:1467] Processing CreateTablet for tablet 70b42650f8a442e1aeb4be9f50b7f86e (DEFAULT_TABLE table=test-table [id=2f32528e6df344c6a8e770fceef44dfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:48.809749 28909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70b42650f8a442e1aeb4be9f50b7f86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:48.809780 29066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70b42650f8a442e1aeb4be9f50b7f86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:48.809780 29221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70b42650f8a442e1aeb4be9f50b7f86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:48.816504 29317 tablet_bootstrap.cc:492] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Bootstrap starting.
I20260807 22:37:48.818282 29318 tablet_bootstrap.cc:492] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: Bootstrap starting.
I20260807 22:37:48.819512 29317 tablet_bootstrap.cc:654] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:48.819995 29318 tablet_bootstrap.cc:654] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:48.820372 29317 log.cc:824] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:48.820454 29320 tablet_bootstrap.cc:492] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: Bootstrap starting.
I20260807 22:37:48.820724 29318 log.cc:824] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:48.822373 29320 tablet_bootstrap.cc:654] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:48.822688 29317 tablet_bootstrap.cc:492] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: No bootstrap required, opened a new log
I20260807 22:37:48.822691 29318 tablet_bootstrap.cc:492] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: No bootstrap required, opened a new log
I20260807 22:37:48.822880 29317 ts_tablet_manager.cc:1397] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 22:37:48.823043 29318 ts_tablet_manager.cc:1397] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:37:48.823529 29320 log.cc:824] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:48.825181 29320 tablet_bootstrap.cc:492] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: No bootstrap required, opened a new log
I20260807 22:37:48.825380 29320 ts_tablet_manager.cc:1397] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 22:37:48.826864 29318 raft_consensus.cc:348] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } }
I20260807 22:37:48.826864 29317 raft_consensus.cc:348] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } }
I20260807 22:37:48.827152 29317 raft_consensus.cc:374] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:48.827152 29318 raft_consensus.cc:374] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:48.827211 29318 raft_consensus.cc:729] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d55fbfee394a7b929655294c10229a, State: Initialized, Role: FOLLOWER
I20260807 22:37:48.827221 29317 raft_consensus.cc:729] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6cbd8a12e0b407aa9d2bbe7e4dab6b3, State: Initialized, Role: FOLLOWER
I20260807 22:37:48.827677 29317 consensus_queue.cc:260] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } }
I20260807 22:37:48.827677 29318 consensus_queue.cc:260] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } }
I20260807 22:37:48.828373 28981 heartbeater.cc:503] Master 127.26.52.126:43161 was elected leader, sending a full tablet report...
I20260807 22:37:48.828709 29317 ts_tablet_manager.cc:1428] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:37:48.828662 29320 raft_consensus.cc:348] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } }
I20260807 22:37:48.828935 29320 raft_consensus.cc:374] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:48.828997 29320 raft_consensus.cc:729] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9924b49d7b144d88b5884d45ea5035a7, State: Initialized, Role: FOLLOWER
I20260807 22:37:48.829355 29320 consensus_queue.cc:260] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } }
I20260807 22:37:48.829805 29318 ts_tablet_manager.cc:1428] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:37:48.830154 29293 heartbeater.cc:503] Master 127.26.52.126:43161 was elected leader, sending a full tablet report...
I20260807 22:37:48.830302 29320 ts_tablet_manager.cc:1428] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:37:48.831049 29137 heartbeater.cc:503] Master 127.26.52.126:43161 was elected leader, sending a full tablet report...
W20260807 22:37:48.997632 29294 tablet.cc:2369] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:37:49.031699 29138 tablet.cc:2369] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:37:49.060658 28982 tablet.cc:2369] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:37:49.118528 29327 raft_consensus.cc:482] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:37:49.118795 29327 raft_consensus.cc:504] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } }
I20260807 22:37:49.120013 29327 leader_election.cc:288] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211), b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195)
I20260807 22:37:49.125180 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.120374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:44239 (local address 127.26.52.65:40195)
0807 22:37:49.120561 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.120567 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.120763 (+ 196us) server_negotiation.cc:407] Connection header received
0807 22:37:49.120973 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.120976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.121034 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.121117 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:49.121441 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.122168 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.123807 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.124445 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.124573 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.124626 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.124973 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.125047 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 22:37:49.125178 29315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.120388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:56053 (local address 127.26.52.67:36211)
0807 22:37:49.120600 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.120606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.120624 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:37:49.120812 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.120817 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.120862 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.120948 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:49.121253 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.122063 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.123807 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.124455 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.124572 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.124626 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.124973 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.125047 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260807 22:37:49.125227 29328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.120263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:36211 (local address 127.26.52.66:56053)
0807 22:37:49.120553 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:49.120569 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:49.120688 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:49.120974 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:49.120976 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:49.120993 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:49.121111 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.121116 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.122198 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.122202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.123672 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.123683 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.124574 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.124578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.124779 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.124857 (+ 78us) client_negotiation.cc:769] Sending connection context
0807 22:37:49.124934 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:37:49.125037 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":230,"thread_start_us":77,"threads_started":1}
I20260807 22:37:49.125229 29329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.120305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40195 (local address 127.26.52.66:44239)
0807 22:37:49.120674 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:49.120685 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:49.120852 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:49.121126 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:49.121129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:49.121162 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:49.121279 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.121284 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.122268 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.122271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.123672 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.123683 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.124574 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.124578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.124777 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.124850 (+ 73us) client_negotiation.cc:769] Sending connection context
0807 22:37:49.124942 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 22:37:49.125037 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":139,"thread_start_us":92,"threads_started":1}
I20260807 22:37:49.126017 29241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70b42650f8a442e1aeb4be9f50b7f86e" candidate_uuid: "9924b49d7b144d88b5884d45ea5035a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d55fbfee394a7b929655294c10229a" is_pre_election: true
I20260807 22:37:49.126030 28934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70b42650f8a442e1aeb4be9f50b7f86e" candidate_uuid: "9924b49d7b144d88b5884d45ea5035a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" is_pre_election: true
I20260807 22:37:49.126379 29241 raft_consensus.cc:2454] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9924b49d7b144d88b5884d45ea5035a7 in term 0.
I20260807 22:37:49.126379 28934 raft_consensus.cc:2454] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9924b49d7b144d88b5884d45ea5035a7 in term 0.
I20260807 22:37:49.126924 29011 leader_election.cc:302] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9924b49d7b144d88b5884d45ea5035a7, b6cbd8a12e0b407aa9d2bbe7e4dab6b3, d5d55fbfee394a7b929655294c10229a; no voters:
I20260807 22:37:49.127228 29327 raft_consensus.cc:2781] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:37:49.127331 29327 raft_consensus.cc:482] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:37:49.127415 29327 raft_consensus.cc:3037] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:49.128548 29327 raft_consensus.cc:504] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } }
I20260807 22:37:49.128934 29327 leader_election.cc:288] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [CANDIDATE]: Term 1 election: Requested vote from peers d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211), b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195)
I20260807 22:37:49.129293 29241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70b42650f8a442e1aeb4be9f50b7f86e" candidate_uuid: "9924b49d7b144d88b5884d45ea5035a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d55fbfee394a7b929655294c10229a"
I20260807 22:37:49.129293 28934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70b42650f8a442e1aeb4be9f50b7f86e" candidate_uuid: "9924b49d7b144d88b5884d45ea5035a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3"
I20260807 22:37:49.129396 29241 raft_consensus.cc:3037] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:49.129429 28934 raft_consensus.cc:3037] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:49.130422 28934 raft_consensus.cc:2454] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9924b49d7b144d88b5884d45ea5035a7 in term 1.
I20260807 22:37:49.130777 29010 leader_election.cc:302] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9924b49d7b144d88b5884d45ea5035a7, b6cbd8a12e0b407aa9d2bbe7e4dab6b3; no voters:
I20260807 22:37:49.130967 29327 raft_consensus.cc:2781] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:49.131161 29327 raft_consensus.cc:686] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 1 LEADER]: Becoming Leader. State: Replica: 9924b49d7b144d88b5884d45ea5035a7, State: Running, Role: LEADER
I20260807 22:37:49.131188 29241 raft_consensus.cc:2454] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9924b49d7b144d88b5884d45ea5035a7 in term 1.
I20260807 22:37:49.131516 29327 consensus_queue.cc:237] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } }
I20260807 22:37:49.134989 28759 catalog_manager.cc:5495] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66). New cstate: current_term: 1 leader_uuid: "9924b49d7b144d88b5884d45ea5035a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } health_report { overall_health: UNKNOWN } } }
Aug 07 22:37:49 dist-test-slave-8w9v krb5kdc[28710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142267, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:49.198712 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.190025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:43161 (local address 127.0.0.1:35174)
0807 22:37:49.190358 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:49.190371 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:49.190519 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:49.190771 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:49.190774 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:49.191195 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:49.191292 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.191298 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.192042 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.192047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.192671 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.192680 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.193126 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.193130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.193206 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.193745 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:49.193757 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:49.195229 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:49.197108 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:49.197120 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:49.197128 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:49.197356 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:49.197648 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:49.197651 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:49.197653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:49.197733 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:49.198107 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:49.198115 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:49.198232 (+ 117us) client_negotiation.cc:769] Sending connection context
0807 22:37:49.198348 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 22:37:49.198502 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":116,"threads_started":1}
I20260807 22:37:49.198711 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.190071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35174 (local address 127.26.52.126:43161)
0807 22:37:49.190230 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.190236 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.190455 (+ 219us) server_negotiation.cc:407] Connection header received
0807 22:37:49.190617 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.190620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.190665 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.190751 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:49.191413 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.191933 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.192788 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.193006 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.193121 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.195402 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:49.195410 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:49.195418 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:49.195437 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:49.196999 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:49.197459 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:49.197464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:49.197466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:49.197541 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:49.197821 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:49.197826 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:49.197828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:49.198002 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:49.198106 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.198395 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.198552 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":52}
I20260807 22:37:49.202919 28759 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:35174:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 22:37:49.203703 28759 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:37:49.209056 29066 tablet_service.cc:1467] Processing CreateTablet for tablet 52441af185434a22ab7cb4d20e9870f9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a1a5bb49d42443348e0b909e377881d5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:37:49.209082 29221 tablet_service.cc:1467] Processing CreateTablet for tablet 52441af185434a22ab7cb4d20e9870f9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a1a5bb49d42443348e0b909e377881d5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:37:49.209031 28909 tablet_service.cc:1467] Processing CreateTablet for tablet 52441af185434a22ab7cb4d20e9870f9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a1a5bb49d42443348e0b909e377881d5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:37:49.209798 29066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52441af185434a22ab7cb4d20e9870f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:49.209800 29221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52441af185434a22ab7cb4d20e9870f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:49.209800 28909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52441af185434a22ab7cb4d20e9870f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:49.212262 29320 tablet_bootstrap.cc:492] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: Bootstrap starting.
I20260807 22:37:49.212666 29317 tablet_bootstrap.cc:492] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Bootstrap starting.
I20260807 22:37:49.212666 29318 tablet_bootstrap.cc:492] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: Bootstrap starting.
I20260807 22:37:49.213620 29320 tablet_bootstrap.cc:654] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:49.213663 29317 tablet_bootstrap.cc:654] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:49.213682 29318 tablet_bootstrap.cc:654] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:49.215297 29320 tablet_bootstrap.cc:492] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: No bootstrap required, opened a new log
I20260807 22:37:49.215386 29320 ts_tablet_manager.cc:1397] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:37:49.215591 29317 tablet_bootstrap.cc:492] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: No bootstrap required, opened a new log
I20260807 22:37:49.215605 29318 tablet_bootstrap.cc:492] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: No bootstrap required, opened a new log
I20260807 22:37:49.215660 29317 ts_tablet_manager.cc:1397] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:37:49.215682 29318 ts_tablet_manager.cc:1397] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:37:49.215869 29320 raft_consensus.cc:348] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.216006 29320 raft_consensus.cc:374] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:49.216042 29320 raft_consensus.cc:729] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9924b49d7b144d88b5884d45ea5035a7, State: Initialized, Role: FOLLOWER
I20260807 22:37:49.216140 29317 raft_consensus.cc:348] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.216245 29317 raft_consensus.cc:374] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:49.216214 29320 consensus_queue.cc:260] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.216279 29317 raft_consensus.cc:729] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6cbd8a12e0b407aa9d2bbe7e4dab6b3, State: Initialized, Role: FOLLOWER
I20260807 22:37:49.216269 29318 raft_consensus.cc:348] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.216384 29318 raft_consensus.cc:374] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:49.216418 29318 raft_consensus.cc:729] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d55fbfee394a7b929655294c10229a, State: Initialized, Role: FOLLOWER
I20260807 22:37:49.216392 29317 consensus_queue.cc:260] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.216529 29320 ts_tablet_manager.cc:1428] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:37:49.216542 29318 consensus_queue.cc:260] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.216665 29317 ts_tablet_manager.cc:1428] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 22:37:49.216778 29318 ts_tablet_manager.cc:1428] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:37:49.216823 29325 tablet_replica.cc:439] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } }
I20260807 22:37:49.216873 29326 tablet_replica.cc:439] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } }
I20260807 22:37:49.216979 29325 tablet_replica.cc:442] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:49.216991 29326 tablet_replica.cc:442] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:49.216513 29327 tablet_replica.cc:439] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } }
I20260807 22:37:49.217744 29327 tablet_replica.cc:442] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:49.467015 29327 raft_consensus.cc:482] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:37:49.467159 29327 raft_consensus.cc:504] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.467623 29327 leader_election.cc:288] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195), d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211)
I20260807 22:37:49.468240 28934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52441af185434a22ab7cb4d20e9870f9" candidate_uuid: "9924b49d7b144d88b5884d45ea5035a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" is_pre_election: true
I20260807 22:37:49.468240 29241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52441af185434a22ab7cb4d20e9870f9" candidate_uuid: "9924b49d7b144d88b5884d45ea5035a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d55fbfee394a7b929655294c10229a" is_pre_election: true
I20260807 22:37:49.468410 28934 raft_consensus.cc:2454] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9924b49d7b144d88b5884d45ea5035a7 in term 0.
I20260807 22:37:49.468410 29241 raft_consensus.cc:2454] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9924b49d7b144d88b5884d45ea5035a7 in term 0.
I20260807 22:37:49.468742 29010 leader_election.cc:302] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9924b49d7b144d88b5884d45ea5035a7, b6cbd8a12e0b407aa9d2bbe7e4dab6b3, d5d55fbfee394a7b929655294c10229a; no voters:
I20260807 22:37:49.468945 29327 raft_consensus.cc:2781] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:37:49.469005 29327 raft_consensus.cc:482] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:37:49.469033 29327 raft_consensus.cc:3037] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:49.470059 29327 raft_consensus.cc:504] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.470389 29327 leader_election.cc:288] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [CANDIDATE]: Term 1 election: Requested vote from peers b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195), d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211)
I20260807 22:37:49.470795 28934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52441af185434a22ab7cb4d20e9870f9" candidate_uuid: "9924b49d7b144d88b5884d45ea5035a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3"
I20260807 22:37:49.470795 29241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52441af185434a22ab7cb4d20e9870f9" candidate_uuid: "9924b49d7b144d88b5884d45ea5035a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d55fbfee394a7b929655294c10229a"
I20260807 22:37:49.470923 29241 raft_consensus.cc:3037] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:49.470937 28934 raft_consensus.cc:3037] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:49.472060 28934 raft_consensus.cc:2454] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9924b49d7b144d88b5884d45ea5035a7 in term 1.
I20260807 22:37:49.472060 29241 raft_consensus.cc:2454] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9924b49d7b144d88b5884d45ea5035a7 in term 1.
I20260807 22:37:49.472375 29010 leader_election.cc:302] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9924b49d7b144d88b5884d45ea5035a7, b6cbd8a12e0b407aa9d2bbe7e4dab6b3, d5d55fbfee394a7b929655294c10229a; no voters:
I20260807 22:37:49.472564 29327 raft_consensus.cc:2781] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:49.472672 29327 raft_consensus.cc:686] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 LEADER]: Becoming Leader. State: Replica: 9924b49d7b144d88b5884d45ea5035a7, State: Running, Role: LEADER
I20260807 22:37:49.472829 29327 consensus_queue.cc:237] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.473527 29330 tablet_replica.cc:439] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: TxnStatusTablet state changed. Reason: New leader 9924b49d7b144d88b5884d45ea5035a7. Latest consensus state: current_term: 1 leader_uuid: "9924b49d7b144d88b5884d45ea5035a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } }
I20260807 22:37:49.473640 29330 tablet_replica.cc:442] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:37:49.473919 29343 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 22:37:49.474207 29343 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 22:37:49.474884 28758 catalog_manager.cc:5495] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66). New cstate: current_term: 1 leader_uuid: "9924b49d7b144d88b5884d45ea5035a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } health_report { overall_health: UNKNOWN } } }
I20260807 22:37:49.512143 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.507871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46032 (local address 127.26.52.66:34553)
0807 22:37:49.508241 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.508252 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.508270 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:37:49.508360 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.508362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.508416 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.508539 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:49.508793 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.509686 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.510549 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.510787 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.510900 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.511238 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:49.511647 (+ 409us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:49.511819 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.511903 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.511954 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":138,"threads_started":1}
I20260807 22:37:49.512110 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.507796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:34553 (local address 127.0.0.1:46032)
0807 22:37:49.508001 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:49.508053 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:49.508191 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:49.508555 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:49.508558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:49.508566 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:37:49.508671 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.508677 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.509809 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.509813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.510420 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.510429 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.510901 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.510905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.511015 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.511059 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:37:49.511796 (+ 737us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:37:49.511813 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 22:37:49.511882 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 22:37:49.511977 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 22:37:49.517553 29241 raft_consensus.cc:1261] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Refusing update from remote peer 9924b49d7b144d88b5884d45ea5035a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:49.517696 28934 raft_consensus.cc:1261] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Refusing update from remote peer 9924b49d7b144d88b5884d45ea5035a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:49.518309 29327 consensus_queue.cc:1035] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:49.518507 29330 consensus_queue.cc:1035] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:49.521944 29325 tablet_replica.cc:439] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: TxnStatusTablet state changed. Reason: New leader 9924b49d7b144d88b5884d45ea5035a7. Latest consensus state: current_term: 1 leader_uuid: "9924b49d7b144d88b5884d45ea5035a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } }
I20260807 22:37:49.522059 29325 tablet_replica.cc:442] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:49.522380 29326 tablet_replica.cc:439] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: TxnStatusTablet state changed. Reason: New leader 9924b49d7b144d88b5884d45ea5035a7. Latest consensus state: current_term: 1 leader_uuid: "9924b49d7b144d88b5884d45ea5035a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } }
I20260807 22:37:49.522507 29326 tablet_replica.cc:442] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:49.525477 29327 tablet_replica.cc:439] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9924b49d7b144d88b5884d45ea5035a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } }
I20260807 22:37:49.525588 29327 tablet_replica.cc:442] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:37:49.525679 29348 mvcc.cc:205] Tried to move back new op lower bound from 7316038735936921600 to 7316038735762022400. Current Snapshot: MvccSnapshot[applied={T|T < 7316038735936921600}]
I20260807 22:37:49.525833 29325 tablet_replica.cc:439] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9924b49d7b144d88b5884d45ea5035a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } }
I20260807 22:37:49.525939 29325 tablet_replica.cc:442] T 52441af185434a22ab7cb4d20e9870f9 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:49.526859 29330 tablet_replica.cc:439] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9924b49d7b144d88b5884d45ea5035a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } }
I20260807 22:37:49.526968 29330 tablet_replica.cc:442] T 52441af185434a22ab7cb4d20e9870f9 P 9924b49d7b144d88b5884d45ea5035a7: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:37:49.527834 29326 tablet_replica.cc:439] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9924b49d7b144d88b5884d45ea5035a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } } }
I20260807 22:37:49.527936 29326 tablet_replica.cc:442] T 52441af185434a22ab7cb4d20e9870f9 P d5d55fbfee394a7b929655294c10229a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:37:49.527999 29350 mvcc.cc:205] Tried to move back new op lower bound from 7316038735936921600 to 7316038735762022400. Current Snapshot: MvccSnapshot[applied={T|T < 7316038735936921600}]
I20260807 22:37:49.537496 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.533783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46042 (local address 127.26.52.66:34553)
0807 22:37:49.533899 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.533904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.534158 (+ 254us) server_negotiation.cc:407] Connection header received
0807 22:37:49.534310 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.534313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.534358 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.534459 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:49.534711 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.535295 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.536412 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.536649 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.536769 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.537036 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:49.537115 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:49.537195 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.537285 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.537337 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:37:49.547766 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.544534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:34597 (local address 127.26.52.66:34553)
0807 22:37:49.544815 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.544819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.544868 (+ 49us) server_negotiation.cc:407] Connection header received
0807 22:37:49.545025 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.545028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.545067 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.545151 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:49.545382 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.545861 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.546702 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.546919 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.547021 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.547322 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:49.547392 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:49.547469 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.547557 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.547602 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":229}
I20260807 22:37:49.547780 29360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.544520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:34553 (local address 127.26.52.66:34597)
0807 22:37:49.544798 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:49.544814 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:49.544916 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:49.545158 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:49.545161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:49.545179 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:37:49.545277 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.545282 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.545970 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.545974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.546589 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.546597 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.547021 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.547024 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.547114 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.547158 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:37:49.547482 (+ 324us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:37:49.547490 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:37:49.547549 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 22:37:49.547618 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":96,"threads_started":1}
I20260807 22:37:49.554591 28934 raft_consensus.cc:1261] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Refusing update from remote peer 9924b49d7b144d88b5884d45ea5035a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:49.554665 29241 raft_consensus.cc:1261] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Refusing update from remote peer 9924b49d7b144d88b5884d45ea5035a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:49.555023 29327 consensus_queue.cc:1035] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:49.555207 29330 consensus_queue.cc:1035] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:49.559386 29349 mvcc.cc:205] Tried to move back new op lower bound from 7316038736092135424 to 7316038734365573120. Current Snapshot: MvccSnapshot[applied={T|T < 7316038736092135424}]
I20260807 22:37:49.592458 28758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:49.592653 28758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:49.595080 28758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84: Sending DeleteTablet for 3 replicas of tablet 70b42650f8a442e1aeb4be9f50b7f86e
I20260807 22:37:49.595696 29066 tablet_service.cc:1514] Processing DeleteTablet for tablet 70b42650f8a442e1aeb4be9f50b7f86e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:49 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:46028
I20260807 22:37:49.595738 29221 tablet_service.cc:1514] Processing DeleteTablet for tablet 70b42650f8a442e1aeb4be9f50b7f86e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:49 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:39790
I20260807 22:37:49.596235 29365 tablet_replica.cc:330] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: stopping tablet replica
I20260807 22:37:49.596266 29366 tablet_replica.cc:330] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: stopping tablet replica
I20260807 22:37:49.596539 29365 raft_consensus.cc:2229] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:37:49.596572 29366 raft_consensus.cc:2229] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:49.596855 29366 raft_consensus.cc:2258] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:49.596868 29365 raft_consensus.cc:2258] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:49.597211 28758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:37:49.597620 28758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:37:49.598186 29366 ts_tablet_manager.cc:1905] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:49.598184 29365 ts_tablet_manager.cc:1905] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:49.601222 29366 ts_tablet_manager.cc:1918] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:37:49.601275 29365 ts_tablet_manager.cc:1918] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:37:49.601320 29366 log.cc:1196] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/70b42650f8a442e1aeb4be9f50b7f86e
I20260807 22:37:49.601362 29365 log.cc:1196] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/70b42650f8a442e1aeb4be9f50b7f86e
I20260807 22:37:49.601660 29366 ts_tablet_manager.cc:1939] T 70b42650f8a442e1aeb4be9f50b7f86e P d5d55fbfee394a7b929655294c10229a: Deleting consensus metadata
I20260807 22:37:49.601734 29365 ts_tablet_manager.cc:1939] T 70b42650f8a442e1aeb4be9f50b7f86e P 9924b49d7b144d88b5884d45ea5035a7: Deleting consensus metadata
I20260807 22:37:49.603332 28744 catalog_manager.cc:4841] TS d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211): tablet 70b42650f8a442e1aeb4be9f50b7f86e (table test-table [id=2f32528e6df344c6a8e770fceef44dfa]) successfully deleted
I20260807 22:37:49.603652 28745 catalog_manager.cc:4841] TS 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553): tablet 70b42650f8a442e1aeb4be9f50b7f86e (table test-table [id=2f32528e6df344c6a8e770fceef44dfa]) successfully deleted
I20260807 22:37:49.603979 29221 tablet_service.cc:1467] Processing CreateTablet for tablet cf7b0d9903fa449294c8246d715c6fa4 (DEFAULT_TABLE table=test-table [id=633af40a86694b20aa9126975aab9c32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:49.603979 29066 tablet_service.cc:1467] Processing CreateTablet for tablet cf7b0d9903fa449294c8246d715c6fa4 (DEFAULT_TABLE table=test-table [id=633af40a86694b20aa9126975aab9c32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:49.604265 29066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf7b0d9903fa449294c8246d715c6fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:49.604278 29221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf7b0d9903fa449294c8246d715c6fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:49.606029 29318 tablet_bootstrap.cc:492] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a: Bootstrap starting.
I20260807 22:37:49.606572 29320 tablet_bootstrap.cc:492] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7: Bootstrap starting.
I20260807 22:37:49.607007 29318 tablet_bootstrap.cc:654] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:49.607307 28909 tablet_service.cc:1514] Processing DeleteTablet for tablet 70b42650f8a442e1aeb4be9f50b7f86e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:49 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:47084
I20260807 22:37:49.607517 29320 tablet_bootstrap.cc:654] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:49.607960 28908 tablet_service.cc:1467] Processing CreateTablet for tablet cf7b0d9903fa449294c8246d715c6fa4 (DEFAULT_TABLE table=test-table [id=633af40a86694b20aa9126975aab9c32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:49.608284 28908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf7b0d9903fa449294c8246d715c6fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:49.608340 29318 tablet_bootstrap.cc:492] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a: No bootstrap required, opened a new log
I20260807 22:37:49.608412 29318 ts_tablet_manager.cc:1397] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:37:49.608855 29318 raft_consensus.cc:348] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.608966 29318 raft_consensus.cc:374] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:49.609000 29318 raft_consensus.cc:729] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d55fbfee394a7b929655294c10229a, State: Initialized, Role: FOLLOWER
I20260807 22:37:49.609126 29318 consensus_queue.cc:260] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.609349 29320 tablet_bootstrap.cc:492] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7: No bootstrap required, opened a new log
I20260807 22:37:49.609386 29318 ts_tablet_manager.cc:1428] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:37:49.609532 29320 ts_tablet_manager.cc:1397] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 22:37:49.610014 29320 raft_consensus.cc:348] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.610136 29320 raft_consensus.cc:374] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:49.610170 29320 raft_consensus.cc:729] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9924b49d7b144d88b5884d45ea5035a7, State: Initialized, Role: FOLLOWER
I20260807 22:37:49.610293 29320 consensus_queue.cc:260] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.610565 29320 ts_tablet_manager.cc:1428] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:37:49.611074 29317 tablet_bootstrap.cc:492] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Bootstrap starting.
I20260807 22:37:49.612040 29317 tablet_bootstrap.cc:654] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:49.613634 29369 tablet_replica.cc:330] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: stopping tablet replica
I20260807 22:37:49.613969 29369 raft_consensus.cc:2229] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:49.614221 29369 raft_consensus.cc:2258] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:49.615154 29317 tablet_bootstrap.cc:492] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: No bootstrap required, opened a new log
I20260807 22:37:49.615252 29317 ts_tablet_manager.cc:1397] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260807 22:37:49.615679 29317 raft_consensus.cc:348] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.615744 29369 ts_tablet_manager.cc:1905] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:49.615805 29317 raft_consensus.cc:374] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:49.615872 29317 raft_consensus.cc:729] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6cbd8a12e0b407aa9d2bbe7e4dab6b3, State: Initialized, Role: FOLLOWER
I20260807 22:37:49.616015 29317 consensus_queue.cc:260] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.616425 29317 ts_tablet_manager.cc:1428] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:37:49.619561 29369 ts_tablet_manager.cc:1918] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:37:49.619704 29369 log.cc:1196] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/70b42650f8a442e1aeb4be9f50b7f86e
I20260807 22:37:49.620048 29369 ts_tablet_manager.cc:1939] T 70b42650f8a442e1aeb4be9f50b7f86e P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Deleting consensus metadata
I20260807 22:37:49.621270 28743 catalog_manager.cc:4841] TS b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195): tablet 70b42650f8a442e1aeb4be9f50b7f86e (table test-table [id=2f32528e6df344c6a8e770fceef44dfa]) successfully deleted
I20260807 22:37:49.625415 29325 raft_consensus.cc:482] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:37:49.625522 29325 raft_consensus.cc:504] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.626662 29325 leader_election.cc:288] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553), d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211)
I20260807 22:37:49.631320 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.627158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:46269 (local address 127.26.52.66:34553)
0807 22:37:49.627311 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.627317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.627335 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:37:49.627391 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.627394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.627443 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.627528 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:49.627833 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.628610 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.630125 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.630682 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.630795 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.630841 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.631132 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.631204 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 22:37:49.631333 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.626815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:34553 (local address 127.26.52.65:46269)
0807 22:37:49.627132 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:49.627148 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:49.627263 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:49.627550 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:49.627553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:49.627570 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:49.627693 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.627698 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.628748 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.628751 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.630003 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.630013 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.630921 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.630924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.630993 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.631012 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 22:37:49.631100 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:37:49.631171 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":30,"spinlock_wait_cycles":20736,"thread_start_us":82,"threads_started":1}
I20260807 22:37:49.631865 29372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.626940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:36211 (local address 127.26.52.65:54091)
0807 22:37:49.627526 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:49.627540 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:49.627630 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:49.628059 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:49.628062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:49.628078 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:49.628239 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.628245 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.629086 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.629090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.629896 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.629906 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.630789 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.630793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.631562 (+ 769us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.631584 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:37:49.631658 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:37:49.631718 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":34,"thread_start_us":50,"threads_started":1}
I20260807 22:37:49.632045 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.627227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:54091 (local address 127.26.52.67:36211)
0807 22:37:49.627840 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.627844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.627857 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:37:49.627903 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.627905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.627948 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.628040 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:49.628363 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.628971 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.630022 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.630656 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.630789 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.630841 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.631706 (+ 865us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.631802 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":78,"threads_started":1}
I20260807 22:37:49.632241 29087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf7b0d9903fa449294c8246d715c6fa4" candidate_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9924b49d7b144d88b5884d45ea5035a7" is_pre_election: true
I20260807 22:37:49.632442 29087 raft_consensus.cc:2454] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6cbd8a12e0b407aa9d2bbe7e4dab6b3 in term 0.
I20260807 22:37:49.632771 29241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf7b0d9903fa449294c8246d715c6fa4" candidate_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d55fbfee394a7b929655294c10229a" is_pre_election: true
I20260807 22:37:49.632897 29241 raft_consensus.cc:2454] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6cbd8a12e0b407aa9d2bbe7e4dab6b3 in term 0.
I20260807 22:37:49.632907 28857 leader_election.cc:302] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9924b49d7b144d88b5884d45ea5035a7, b6cbd8a12e0b407aa9d2bbe7e4dab6b3; no voters:
I20260807 22:37:49.633168 29325 raft_consensus.cc:2781] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:37:49.633234 29325 raft_consensus.cc:482] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:37:49.633342 29325 raft_consensus.cc:3037] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:49.634420 29325 raft_consensus.cc:504] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.634799 29325 leader_election.cc:288] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [CANDIDATE]: Term 1 election: Requested vote from peers 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553), d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211)
I20260807 22:37:49.635145 29087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf7b0d9903fa449294c8246d715c6fa4" candidate_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9924b49d7b144d88b5884d45ea5035a7"
I20260807 22:37:49.635150 29241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf7b0d9903fa449294c8246d715c6fa4" candidate_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d55fbfee394a7b929655294c10229a"
I20260807 22:37:49.635268 29087 raft_consensus.cc:3037] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:49.635306 29241 raft_consensus.cc:3037] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:49.636499 29241 raft_consensus.cc:2454] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6cbd8a12e0b407aa9d2bbe7e4dab6b3 in term 1.
I20260807 22:37:49.636622 29087 raft_consensus.cc:2454] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6cbd8a12e0b407aa9d2bbe7e4dab6b3 in term 1.
I20260807 22:37:49.637452 28856 leader_election.cc:302] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6cbd8a12e0b407aa9d2bbe7e4dab6b3, d5d55fbfee394a7b929655294c10229a; no voters:
I20260807 22:37:49.637634 29325 raft_consensus.cc:2781] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:49.637838 29325 raft_consensus.cc:686] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 LEADER]: Becoming Leader. State: Replica: b6cbd8a12e0b407aa9d2bbe7e4dab6b3, State: Running, Role: LEADER
I20260807 22:37:49.638082 29325 consensus_queue.cc:237] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:49.640429 28759 catalog_manager.cc:5495] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65). New cstate: current_term: 1 leader_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } health_report { overall_health: UNKNOWN } } }
I20260807 22:37:49.658126 29377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.654239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47090 (local address 127.26.52.65:40195)
0807 22:37:49.654539 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.654557 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.654568 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:37:49.654628 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.654630 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.654677 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.654838 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:49.655099 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.655641 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.656565 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.656799 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.656971 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.657245 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:49.657704 (+ 459us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:49.657831 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.657895 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.657958 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":104,"threads_started":1}
I20260807 22:37:49.668754 29346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.665281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:45113 (local address 127.26.52.66:34553)
0807 22:37:49.665517 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.665521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.665538 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:37:49.665695 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.665697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.665738 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.665798 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:49.666085 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.666648 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.667794 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.667997 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.668068 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.668385 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:49.668447 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:49.668501 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.668613 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.668654 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260807 22:37:49.668838 29380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.665143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:34553 (local address 127.26.52.65:45113)
0807 22:37:49.665475 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:49.665491 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:49.665583 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:49.665830 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:49.665833 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:49.665841 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:37:49.665955 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.665960 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.666756 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.666759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.667679 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.667690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.668095 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.668099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.668213 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.668264 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:37:49.668526 (+ 262us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:37:49.668533 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:37:49.668595 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 22:37:49.668672 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":110,"threads_started":1}
I20260807 22:37:49.675583 29241 raft_consensus.cc:1261] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Refusing update from remote peer b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:49.675881 29087 raft_consensus.cc:1261] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Refusing update from remote peer b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:49.676060 29325 consensus_queue.cc:1035] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:49.676488 29375 consensus_queue.cc:1035] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:49.695812 29360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.691975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40195 (local address 127.26.52.66:37791)
0807 22:37:49.692122 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:49.692138 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:49.692239 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:49.692596 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:49.692599 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:49.692607 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:37:49.692692 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.692696 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.693691 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.693693 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.694449 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:49.694459 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.695128 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.695132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:49.695216 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.695247 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:37:49.695580 (+ 333us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:37:49.695586 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:37:49.695645 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 22:37:49.695710 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 22:37:49.695839 29377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:49.692177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:37791 (local address 127.26.52.65:40195)
0807 22:37:49.692286 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:49.692291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:49.692304 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:37:49.692348 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:49.692351 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:49.692403 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:49.692485 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:49.692783 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.693586 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.694596 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:49.694943 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:49.695045 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:49.695414 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:49.695494 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:49.695562 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:49.695655 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 22:37:49.695705 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 22:37:49.696967 29350 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 22:37:51.255897 28759 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:51.256099 28759 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:51.258445 28759 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84: Sending DeleteTablet for 3 replicas of tablet cf7b0d9903fa449294c8246d715c6fa4
I20260807 22:37:51.258966 28908 tablet_service.cc:1514] Processing DeleteTablet for tablet cf7b0d9903fa449294c8246d715c6fa4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:51 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:47084
I20260807 22:37:51.259021 29066 tablet_service.cc:1514] Processing DeleteTablet for tablet cf7b0d9903fa449294c8246d715c6fa4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:51 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:46028
I20260807 22:37:51.259312 29407 tablet_replica.cc:330] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: stopping tablet replica
I20260807 22:37:51.259320 29221 tablet_service.cc:1514] Processing DeleteTablet for tablet cf7b0d9903fa449294c8246d715c6fa4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:51 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:39790
I20260807 22:37:51.259364 29408 tablet_replica.cc:330] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7: stopping tablet replica
I20260807 22:37:51.259435 29407 raft_consensus.cc:2229] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:37:51.259490 29408 raft_consensus.cc:2229] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:51.259598 29408 raft_consensus.cc:2258] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:51.259775 29407 raft_consensus.cc:2258] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:51.260367 29408 ts_tablet_manager.cc:1905] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:51.263684 29407 ts_tablet_manager.cc:1905] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:51.264456 29409 tablet_replica.cc:330] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a: stopping tablet replica
I20260807 22:37:51.264636 29409 raft_consensus.cc:2229] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:51.264772 29409 raft_consensus.cc:2258] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:51.264846 29408 ts_tablet_manager.cc:1918] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:37:51.264989 29408 log.cc:1196] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/cf7b0d9903fa449294c8246d715c6fa4
I20260807 22:37:51.265465 29408 ts_tablet_manager.cc:1939] T cf7b0d9903fa449294c8246d715c6fa4 P 9924b49d7b144d88b5884d45ea5035a7: Deleting consensus metadata
I20260807 22:37:51.266234 28745 catalog_manager.cc:4841] TS 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553): tablet cf7b0d9903fa449294c8246d715c6fa4 (table test-table [id=633af40a86694b20aa9126975aab9c32]) successfully deleted
I20260807 22:37:51.266441 29409 ts_tablet_manager.cc:1905] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:51.268028 29407 ts_tablet_manager.cc:1918] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:37:51.268124 29407 log.cc:1196] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/cf7b0d9903fa449294c8246d715c6fa4
I20260807 22:37:51.268509 29407 ts_tablet_manager.cc:1939] T cf7b0d9903fa449294c8246d715c6fa4 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Deleting consensus metadata
I20260807 22:37:51.269296 28743 catalog_manager.cc:4841] TS b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195): tablet cf7b0d9903fa449294c8246d715c6fa4 (table test-table [id=633af40a86694b20aa9126975aab9c32]) successfully deleted
I20260807 22:37:51.269433 29409 ts_tablet_manager.cc:1918] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:37:51.269515 29409 log.cc:1196] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/cf7b0d9903fa449294c8246d715c6fa4
I20260807 22:37:51.269770 29409 ts_tablet_manager.cc:1939] T cf7b0d9903fa449294c8246d715c6fa4 P d5d55fbfee394a7b929655294c10229a: Deleting consensus metadata
I20260807 22:37:51.270485 28744 catalog_manager.cc:4841] TS d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211): tablet cf7b0d9903fa449294c8246d715c6fa4 (table test-table [id=633af40a86694b20aa9126975aab9c32]) successfully deleted
Aug 07 22:37:51 dist-test-slave-8w9v krb5kdc[28710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142271, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:37:51 dist-test-slave-8w9v krb5kdc[28710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142271, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:51.294967 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.282429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35182 (local address 127.26.52.126:43161)
0807 22:37:51.282727 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:51.282737 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:51.282911 (+ 174us) server_negotiation.cc:407] Connection header received
0807 22:37:51.283114 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:51.283121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:51.283165 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:51.283260 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:51.283984 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.284607 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.285461 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.285785 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.285897 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.291917 (+ 6020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:51.291920 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:51.291923 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:51.291948 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:51.293264 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:51.293673 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:51.293677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:51.293681 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:51.293779 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:51.294059 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:51.294063 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:51.294064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:51.294245 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:51.294392 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:51.294657 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 22:37:51.294783 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":121,"threads_started":1}
I20260807 22:37:51.297482 28759 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:37:51.297868 28759 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:37:51.302312 28908 tablet_service.cc:1467] Processing CreateTablet for tablet 2b59bb4149df4312b09ed6b52ae16d43 (DEFAULT_TABLE table=test-table [id=bce65afc237647948e5bbdcb3c4ec241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:51.302440 29066 tablet_service.cc:1467] Processing CreateTablet for tablet 2b59bb4149df4312b09ed6b52ae16d43 (DEFAULT_TABLE table=test-table [id=bce65afc237647948e5bbdcb3c4ec241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:51.302525 29221 tablet_service.cc:1467] Processing CreateTablet for tablet 2b59bb4149df4312b09ed6b52ae16d43 (DEFAULT_TABLE table=test-table [id=bce65afc237647948e5bbdcb3c4ec241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:51.302652 28908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b59bb4149df4312b09ed6b52ae16d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:51.302754 29066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b59bb4149df4312b09ed6b52ae16d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:51.302778 29221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b59bb4149df4312b09ed6b52ae16d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:51.304795 29419 tablet_bootstrap.cc:492] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Bootstrap starting.
I20260807 22:37:51.305331 29421 tablet_bootstrap.cc:492] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7: Bootstrap starting.
I20260807 22:37:51.305766 29419 tablet_bootstrap.cc:654] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:51.306193 29421 tablet_bootstrap.cc:654] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:51.306804 29420 tablet_bootstrap.cc:492] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a: Bootstrap starting.
I20260807 22:37:51.307154 29419 tablet_bootstrap.cc:492] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: No bootstrap required, opened a new log
I20260807 22:37:51.307397 29419 ts_tablet_manager.cc:1397] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:37:51.307446 29421 tablet_bootstrap.cc:492] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7: No bootstrap required, opened a new log
I20260807 22:37:51.307534 29421 ts_tablet_manager.cc:1397] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:37:51.307672 29420 tablet_bootstrap.cc:654] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:51.307857 29419 raft_consensus.cc:348] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.308065 29419 raft_consensus.cc:374] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:51.308151 29419 raft_consensus.cc:729] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6cbd8a12e0b407aa9d2bbe7e4dab6b3, State: Initialized, Role: FOLLOWER
I20260807 22:37:51.308200 29421 raft_consensus.cc:348] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.308302 29421 raft_consensus.cc:374] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:51.308331 29421 raft_consensus.cc:729] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9924b49d7b144d88b5884d45ea5035a7, State: Initialized, Role: FOLLOWER
I20260807 22:37:51.308306 29419 consensus_queue.cc:260] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.308506 29421 consensus_queue.cc:260] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.308673 29419 ts_tablet_manager.cc:1428] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:37:51.309101 29421 ts_tablet_manager.cc:1428] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:37:51.310156 29420 tablet_bootstrap.cc:492] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a: No bootstrap required, opened a new log
I20260807 22:37:51.310237 29420 ts_tablet_manager.cc:1397] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:37:51.311780 29420 raft_consensus.cc:348] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.311896 29420 raft_consensus.cc:374] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:51.311935 29420 raft_consensus.cc:729] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d55fbfee394a7b929655294c10229a, State: Initialized, Role: FOLLOWER
I20260807 22:37:51.312088 29420 consensus_queue.cc:260] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.312502 29420 ts_tablet_manager.cc:1428] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:37:51.316540 29402 raft_consensus.cc:482] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:37:51.316636 29402 raft_consensus.cc:504] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.317049 29402 leader_election.cc:288] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553), d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211)
I20260807 22:37:51.317368 29241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b59bb4149df4312b09ed6b52ae16d43" candidate_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d55fbfee394a7b929655294c10229a" is_pre_election: true
I20260807 22:37:51.317374 29087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b59bb4149df4312b09ed6b52ae16d43" candidate_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9924b49d7b144d88b5884d45ea5035a7" is_pre_election: true
I20260807 22:37:51.317502 29087 raft_consensus.cc:2454] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6cbd8a12e0b407aa9d2bbe7e4dab6b3 in term 0.
I20260807 22:37:51.317502 29241 raft_consensus.cc:2454] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6cbd8a12e0b407aa9d2bbe7e4dab6b3 in term 0.
I20260807 22:37:51.317812 28857 leader_election.cc:302] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9924b49d7b144d88b5884d45ea5035a7, b6cbd8a12e0b407aa9d2bbe7e4dab6b3; no voters:
I20260807 22:37:51.318038 29402 raft_consensus.cc:2781] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:37:51.318087 29402 raft_consensus.cc:482] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:37:51.318114 29402 raft_consensus.cc:3037] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:51.319012 29402 raft_consensus.cc:504] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.319343 29402 leader_election.cc:288] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [CANDIDATE]: Term 1 election: Requested vote from peers 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553), d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211)
I20260807 22:37:51.319644 29241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b59bb4149df4312b09ed6b52ae16d43" candidate_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d55fbfee394a7b929655294c10229a"
I20260807 22:37:51.319703 29087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b59bb4149df4312b09ed6b52ae16d43" candidate_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9924b49d7b144d88b5884d45ea5035a7"
I20260807 22:37:51.319749 29241 raft_consensus.cc:3037] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:51.319804 29087 raft_consensus.cc:3037] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:51.320818 29087 raft_consensus.cc:2454] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6cbd8a12e0b407aa9d2bbe7e4dab6b3 in term 1.
I20260807 22:37:51.320818 29241 raft_consensus.cc:2454] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6cbd8a12e0b407aa9d2bbe7e4dab6b3 in term 1.
I20260807 22:37:51.321089 28856 leader_election.cc:302] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6cbd8a12e0b407aa9d2bbe7e4dab6b3, d5d55fbfee394a7b929655294c10229a; no voters:
I20260807 22:37:51.321302 29402 raft_consensus.cc:2781] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:51.321410 29402 raft_consensus.cc:686] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 LEADER]: Becoming Leader. State: Replica: b6cbd8a12e0b407aa9d2bbe7e4dab6b3, State: Running, Role: LEADER
I20260807 22:37:51.321539 29402 consensus_queue.cc:237] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.322968 28759 catalog_manager.cc:5495] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65). New cstate: current_term: 1 leader_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } health_report { overall_health: UNKNOWN } } }
I20260807 22:37:51.342404 29428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.338713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47106 (local address 127.26.52.65:40195)
0807 22:37:51.338995 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:51.339003 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:51.339014 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:37:51.339049 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:51.339051 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:51.339089 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:51.339305 (+ 216us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:51.339582 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.340217 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.341102 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.341377 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.341522 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.341875 (+ 353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:51.341979 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:51.342049 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:51.342185 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 22:37:51.342237 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":100,"threads_started":1}
I20260807 22:37:51.349053 29087 raft_consensus.cc:1261] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Refusing update from remote peer b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:51.349135 29241 raft_consensus.cc:1261] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Refusing update from remote peer b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:51.349452 29398 consensus_queue.cc:1035] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:51.349614 29402 consensus_queue.cc:1035] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:51.382704 28758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:51.382884 28758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:51.384816 28758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84: Sending DeleteTablet for 3 replicas of tablet 2b59bb4149df4312b09ed6b52ae16d43
I20260807 22:37:51.385331 29066 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b59bb4149df4312b09ed6b52ae16d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:51 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:46028
I20260807 22:37:51.385349 28908 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b59bb4149df4312b09ed6b52ae16d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:51 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:47084
I20260807 22:37:51.385404 29221 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b59bb4149df4312b09ed6b52ae16d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:51 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:39790
I20260807 22:37:51.385522 29408 tablet_replica.cc:330] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7: stopping tablet replica
I20260807 22:37:51.385533 29407 tablet_replica.cc:330] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: stopping tablet replica
I20260807 22:37:51.385583 29409 tablet_replica.cc:330] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a: stopping tablet replica
I20260807 22:37:51.385643 29407 raft_consensus.cc:2229] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:37:51.385638 29408 raft_consensus.cc:2229] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:51.385670 29409 raft_consensus.cc:2229] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:51.385735 29408 raft_consensus.cc:2258] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:51.385759 29409 raft_consensus.cc:2258] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:51.385775 29407 raft_consensus.cc:2258] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:51.386411 29408 ts_tablet_manager.cc:1905] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:51.386504 29407 ts_tablet_manager.cc:1905] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:51.386504 29409 ts_tablet_manager.cc:1905] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:51.388685 29408 ts_tablet_manager.cc:1918] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:37:51.388788 29408 log.cc:1196] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/2b59bb4149df4312b09ed6b52ae16d43
I20260807 22:37:51.388969 29409 ts_tablet_manager.cc:1918] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:37:51.389063 29409 log.cc:1196] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/2b59bb4149df4312b09ed6b52ae16d43
I20260807 22:37:51.389093 29408 ts_tablet_manager.cc:1939] T 2b59bb4149df4312b09ed6b52ae16d43 P 9924b49d7b144d88b5884d45ea5035a7: Deleting consensus metadata
I20260807 22:37:51.389216 29407 ts_tablet_manager.cc:1918] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:37:51.389312 29407 log.cc:1196] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/2b59bb4149df4312b09ed6b52ae16d43
I20260807 22:37:51.389349 29409 ts_tablet_manager.cc:1939] T 2b59bb4149df4312b09ed6b52ae16d43 P d5d55fbfee394a7b929655294c10229a: Deleting consensus metadata
I20260807 22:37:51.389570 29407 ts_tablet_manager.cc:1939] T 2b59bb4149df4312b09ed6b52ae16d43 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Deleting consensus metadata
I20260807 22:37:51.389758 28745 catalog_manager.cc:4841] TS 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553): tablet 2b59bb4149df4312b09ed6b52ae16d43 (table test-table [id=bce65afc237647948e5bbdcb3c4ec241]) successfully deleted
I20260807 22:37:51.390015 28744 catalog_manager.cc:4841] TS d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211): tablet 2b59bb4149df4312b09ed6b52ae16d43 (table test-table [id=bce65afc237647948e5bbdcb3c4ec241]) successfully deleted
I20260807 22:37:51.390280 28758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 22:37:51.390537 28743 catalog_manager.cc:4841] TS b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195): tablet 2b59bb4149df4312b09ed6b52ae16d43 (table test-table [id=bce65afc237647948e5bbdcb3c4ec241]) successfully deleted
W20260807 22:37:51.390726 28758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:37:51.395092 28908 tablet_service.cc:1467] Processing CreateTablet for tablet deba4fbc0ee745c3a3e369ab2e6afa11 (DEFAULT_TABLE table=test-table [id=94c51c07aee641459ed084bb6371a77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:51.395202 29066 tablet_service.cc:1467] Processing CreateTablet for tablet deba4fbc0ee745c3a3e369ab2e6afa11 (DEFAULT_TABLE table=test-table [id=94c51c07aee641459ed084bb6371a77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:51.395383 28908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deba4fbc0ee745c3a3e369ab2e6afa11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:51.395364 29221 tablet_service.cc:1467] Processing CreateTablet for tablet deba4fbc0ee745c3a3e369ab2e6afa11 (DEFAULT_TABLE table=test-table [id=94c51c07aee641459ed084bb6371a77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:37:51.395486 29066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deba4fbc0ee745c3a3e369ab2e6afa11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:51.395596 29221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deba4fbc0ee745c3a3e369ab2e6afa11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:51.397851 29420 tablet_bootstrap.cc:492] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a: Bootstrap starting.
I20260807 22:37:51.397851 29421 tablet_bootstrap.cc:492] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7: Bootstrap starting.
I20260807 22:37:51.397919 29419 tablet_bootstrap.cc:492] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Bootstrap starting.
I20260807 22:37:51.398727 29421 tablet_bootstrap.cc:654] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:51.398808 29419 tablet_bootstrap.cc:654] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:51.398903 29420 tablet_bootstrap.cc:654] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:51.399825 29419 tablet_bootstrap.cc:492] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: No bootstrap required, opened a new log
I20260807 22:37:51.399829 29421 tablet_bootstrap.cc:492] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7: No bootstrap required, opened a new log
I20260807 22:37:51.399894 29419 ts_tablet_manager.cc:1397] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 22:37:51.399935 29421 ts_tablet_manager.cc:1397] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:37:51.400305 29419 raft_consensus.cc:348] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.400420 29419 raft_consensus.cc:374] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:51.400355 29421 raft_consensus.cc:348] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.400453 29419 raft_consensus.cc:729] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6cbd8a12e0b407aa9d2bbe7e4dab6b3, State: Initialized, Role: FOLLOWER
I20260807 22:37:51.400468 29421 raft_consensus.cc:374] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:51.400506 29421 raft_consensus.cc:729] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9924b49d7b144d88b5884d45ea5035a7, State: Initialized, Role: FOLLOWER
I20260807 22:37:51.400586 29419 consensus_queue.cc:260] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.400628 29421 consensus_queue.cc:260] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.400871 29421 ts_tablet_manager.cc:1428] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:37:51.400873 29419 ts_tablet_manager.cc:1428] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:37:51.402281 29420 tablet_bootstrap.cc:492] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a: No bootstrap required, opened a new log
I20260807 22:37:51.402376 29420 ts_tablet_manager.cc:1397] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260807 22:37:51.402837 29420 raft_consensus.cc:348] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.402947 29420 raft_consensus.cc:374] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:51.402990 29420 raft_consensus.cc:729] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d55fbfee394a7b929655294c10229a, State: Initialized, Role: FOLLOWER
I20260807 22:37:51.403115 29420 consensus_queue.cc:260] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.403865 29420 ts_tablet_manager.cc:1428] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:37:51.495683 29425 raft_consensus.cc:482] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:37:51.495848 29425 raft_consensus.cc:504] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.497149 29425 leader_election.cc:288] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195), 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553)
I20260807 22:37:51.501874 29428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.497463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:54613 (local address 127.26.52.65:40195)
0807 22:37:51.497605 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:51.497610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:51.497961 (+ 351us) server_negotiation.cc:407] Connection header received
0807 22:37:51.498193 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:51.498196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:51.498260 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:51.498341 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:51.498727 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.499306 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.500757 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.501134 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.501268 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.501334 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:51.501642 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 22:37:51.501753 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 22:37:51.501892 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.497295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40195 (local address 127.26.52.67:54613)
0807 22:37:51.497694 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:51.497711 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:51.498020 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:51.498362 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:51.498365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:51.498383 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:51.498605 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:51.498615 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.499417 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.499421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:51.500609 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:51.500619 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.501274 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.501277 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:51.501477 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.501497 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 22:37:51.501560 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 22:37:51.501633 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":33,"thread_start_us":119,"threads_started":1}
I20260807 22:37:51.501989 29436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.497540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:34553 (local address 127.26.52.67:59019)
0807 22:37:51.497917 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:51.497932 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:51.498202 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:51.498632 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:51.498634 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:51.498650 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:37:51.498794 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:51.498801 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.499620 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.499623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:51.500605 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:51.500614 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.501442 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.501447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:51.501624 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.501648 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:37:51.501725 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:37:51.501788 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":45,"thread_start_us":128,"threads_started":1}
I20260807 22:37:51.502311 29437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.497643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:59019 (local address 127.26.52.66:34553)
0807 22:37:51.497941 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:51.497956 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:51.498157 (+ 201us) server_negotiation.cc:407] Connection header received
0807 22:37:51.498325 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:51.498331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:51.498384 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:51.498616 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:37:51.498908 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.499452 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.500723 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.501126 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.501253 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.501308 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:51.502044 (+ 736us) server_negotiation.cc:299] Negotiation successful
0807 22:37:51.502140 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":110,"threads_started":1}
I20260807 22:37:51.502624 28934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deba4fbc0ee745c3a3e369ab2e6afa11" candidate_uuid: "d5d55fbfee394a7b929655294c10229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" is_pre_election: true
I20260807 22:37:51.502784 28934 raft_consensus.cc:2454] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5d55fbfee394a7b929655294c10229a in term 0.
I20260807 22:37:51.503039 29087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deba4fbc0ee745c3a3e369ab2e6afa11" candidate_uuid: "d5d55fbfee394a7b929655294c10229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9924b49d7b144d88b5884d45ea5035a7" is_pre_election: true
I20260807 22:37:51.503214 29087 raft_consensus.cc:2454] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5d55fbfee394a7b929655294c10229a in term 0.
I20260807 22:37:51.503192 29164 leader_election.cc:302] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6cbd8a12e0b407aa9d2bbe7e4dab6b3, d5d55fbfee394a7b929655294c10229a; no voters:
I20260807 22:37:51.503501 29425 raft_consensus.cc:2781] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:37:51.503580 29425 raft_consensus.cc:482] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:37:51.503616 29425 raft_consensus.cc:3037] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:51.505138 29425 raft_consensus.cc:504] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.505455 29425 leader_election.cc:288] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [CANDIDATE]: Term 1 election: Requested vote from peers b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195), 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553)
I20260807 22:37:51.505775 29087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deba4fbc0ee745c3a3e369ab2e6afa11" candidate_uuid: "d5d55fbfee394a7b929655294c10229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9924b49d7b144d88b5884d45ea5035a7"
I20260807 22:37:51.505775 28934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deba4fbc0ee745c3a3e369ab2e6afa11" candidate_uuid: "d5d55fbfee394a7b929655294c10229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3"
I20260807 22:37:51.505894 28934 raft_consensus.cc:3037] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:51.505893 29087 raft_consensus.cc:3037] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:51.506984 29087 raft_consensus.cc:2454] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5d55fbfee394a7b929655294c10229a in term 1.
I20260807 22:37:51.506984 28934 raft_consensus.cc:2454] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5d55fbfee394a7b929655294c10229a in term 1.
I20260807 22:37:51.507288 29166 leader_election.cc:302] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9924b49d7b144d88b5884d45ea5035a7, d5d55fbfee394a7b929655294c10229a; no voters:
I20260807 22:37:51.507450 29425 raft_consensus.cc:2781] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:51.507651 29425 raft_consensus.cc:686] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 1 LEADER]: Becoming Leader. State: Replica: d5d55fbfee394a7b929655294c10229a, State: Running, Role: LEADER
I20260807 22:37:51.507898 29425 consensus_queue.cc:237] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } }
I20260807 22:37:51.510316 28759 catalog_manager.cc:5495] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a reported cstate change: term changed from 0 to 1, leader changed from <none> to d5d55fbfee394a7b929655294c10229a (127.26.52.67). New cstate: current_term: 1 leader_uuid: "d5d55fbfee394a7b929655294c10229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5d55fbfee394a7b929655294c10229a" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36211 } health_report { overall_health: HEALTHY } } }
I20260807 22:37:51.530534 29440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.526756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39804 (local address 127.26.52.67:36211)
0807 22:37:51.527060 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:51.527066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:51.527077 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:37:51.527141 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:51.527143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:51.527189 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:51.527321 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:51.527562 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.528081 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.528981 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.529212 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.529318 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.529702 (+ 384us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:51.530144 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:51.530273 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:51.530332 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 22:37:51.530381 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":146,"threads_started":1}
I20260807 22:37:51.541042 29437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.537642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:47697 (local address 127.26.52.66:34553)
0807 22:37:51.537802 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:51.537806 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:51.537902 (+ 96us) server_negotiation.cc:407] Connection header received
0807 22:37:51.538012 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:51.538014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:51.538058 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:51.538120 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:51.538367 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.538838 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.540004 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.540258 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.540335 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.540659 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:51.540721 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:51.540777 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:51.540905 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 22:37:51.540949 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 22:37:51.541105 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.537436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:34553 (local address 127.26.52.67:47697)
0807 22:37:51.537815 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:51.537829 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:51.537924 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:51.538148 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:51.538150 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:51.538158 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:37:51.538270 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:51.538275 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.538931 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.538934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:51.539894 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:51.539904 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.540364 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.540367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:51.540468 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.540535 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:37:51.540798 (+ 263us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:37:51.540804 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:37:51.540879 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 22:37:51.540951 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":152,"threads_started":1}
I20260807 22:37:51.546810 29087 raft_consensus.cc:1261] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Refusing update from remote peer d5d55fbfee394a7b929655294c10229a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:51.547169 28934 raft_consensus.cc:1261] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Refusing update from remote peer d5d55fbfee394a7b929655294c10229a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:37:51.547273 29425 consensus_queue.cc:1035] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9924b49d7b144d88b5884d45ea5035a7" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 34553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:51.547595 29438 consensus_queue.cc:1035] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6cbd8a12e0b407aa9d2bbe7e4dab6b3" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:37:51.565479 29450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.562154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:36211 (local address 127.26.52.66:34819)
0807 22:37:51.562475 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:51.562488 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:51.562572 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:51.562809 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:51.562812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:51.562820 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:37:51.562920 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:51.562926 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.563608 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.563613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:51.564304 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:51.564313 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.564741 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.564745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:51.564829 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.564865 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:37:51.565177 (+ 312us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:37:51.565184 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:37:51.565250 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 22:37:51.565348 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":175,"threads_started":1}
I20260807 22:37:51.565475 29440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:51.562205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:34819 (local address 127.26.52.67:36211)
0807 22:37:51.562365 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:51.562370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:51.562564 (+ 194us) server_negotiation.cc:407] Connection header received
0807 22:37:51.562645 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:51.562650 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:51.562704 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:51.562799 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:37:51.563029 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.563504 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.564428 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:51.564634 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:51.564738 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:51.564992 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:37:51.565055 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:37:51.565136 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:51.565273 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 22:37:51.565320 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 22:37:51.566208 29388 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 22:37:53.124984 28758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:53.125160 28758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:37:53.127498 28758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4620be73be74452696bfcb4bf80efa84: Sending DeleteTablet for 3 replicas of tablet deba4fbc0ee745c3a3e369ab2e6afa11
I20260807 22:37:53.128046 28908 tablet_service.cc:1514] Processing DeleteTablet for tablet deba4fbc0ee745c3a3e369ab2e6afa11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:53 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:47084
I20260807 22:37:53.128156 29066 tablet_service.cc:1514] Processing DeleteTablet for tablet deba4fbc0ee745c3a3e369ab2e6afa11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:53 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:46028
I20260807 22:37:53.128232 29221 tablet_service.cc:1514] Processing DeleteTablet for tablet deba4fbc0ee745c3a3e369ab2e6afa11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:37:53 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:39790
I20260807 22:37:53.128427 29476 tablet_replica.cc:330] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3: stopping tablet replica
I20260807 22:37:53.128499 29477 tablet_replica.cc:330] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7: stopping tablet replica
I20260807 22:37:53.128578 29476 raft_consensus.cc:2229] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:53.128705 29476 raft_consensus.cc:2258] T deba4fbc0ee745c3a3e369ab2e6afa11 P b6cbd8a12e0b407aa9d2bbe7e4dab6b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:53.128788 29478 tablet_replica.cc:330] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a: stopping tablet replica
I20260807 22:37:53.128878 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 28838
I20260807 22:37:53.129001 29478 raft_consensus.cc:2229] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:37:53.129313 29478 raft_consensus.cc:2258] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:53.130225 29478 ts_tablet_manager.cc:1905] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:53.132925 29478 ts_tablet_manager.cc:1918] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:37:53.133062 29478 log.cc:1196] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/deba4fbc0ee745c3a3e369ab2e6afa11
I20260807 22:37:53.133061 29477 raft_consensus.cc:2229] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:37:53.133221 29477 raft_consensus.cc:2258] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:37:53.133529 29478 ts_tablet_manager.cc:1939] T deba4fbc0ee745c3a3e369ab2e6afa11 P d5d55fbfee394a7b929655294c10229a: Deleting consensus metadata
I20260807 22:37:53.134047 29477 ts_tablet_manager.cc:1905] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:37:53.134574 28744 catalog_manager.cc:4841] TS d5d55fbfee394a7b929655294c10229a (127.26.52.67:36211): tablet deba4fbc0ee745c3a3e369ab2e6afa11 (table test-table [id=94c51c07aee641459ed084bb6371a77c]) successfully deleted
I20260807 22:37:53.136986 29477 ts_tablet_manager.cc:1918] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:37:53.137058 29477 log.cc:1196] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/deba4fbc0ee745c3a3e369ab2e6afa11
I20260807 22:37:53.137310 29477 ts_tablet_manager.cc:1939] T deba4fbc0ee745c3a3e369ab2e6afa11 P 9924b49d7b144d88b5884d45ea5035a7: Deleting consensus metadata
I20260807 22:37:53.137984 28745 catalog_manager.cc:4841] TS 9924b49d7b144d88b5884d45ea5035a7 (127.26.52.66:34553): tablet deba4fbc0ee745c3a3e369ab2e6afa11 (table test-table [id=94c51c07aee641459ed084bb6371a77c]) successfully deleted
W20260807 22:37:53.143810 28743 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:40195 (error 108)
I20260807 22:37:53.144106 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 28991
I20260807 22:37:53.146886 29480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:53.145927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40195 (local address 127.0.0.1:47118)
0807 22:37:53.146635 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:53.146752 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:40195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":85,"threads_started":1}
W20260807 22:37:53.147015 28743 catalog_manager.cc:4584] TS b6cbd8a12e0b407aa9d2bbe7e4dab6b3 (127.26.52.65:40195): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet deba4fbc0ee745c3a3e369ab2e6afa11: Network error: Client connection negotiation failed: client connection to 127.26.52.65:40195: connect: Connection refused (error 111)
I20260807 22:37:53.153630 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 29147
I20260807 22:37:53.161873 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 28724
2026-08-07T22:37:53Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6529 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:37:53 dist-test-slave-8w9v krb5kdc[29483](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:37:53 dist-test-slave-8w9v krb5kdc[29483](info): set up 2 sockets
Aug 07 22:37:53 dist-test-slave-8w9v krb5kdc[29483](info): commencing operation
krb5kdc: starting...
W20260807 22:37:54.230269 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:37:54 dist-test-slave-8w9v krb5kdc[29483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:37:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:37:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:37:54.352070 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:39865
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:39713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:39865
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:54.463559 29497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:54.463848 29497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:54.463936 29497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:54.467905 29497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:37:54.468006 29497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:54.468044 29497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:54.468102 29497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:37:54.468170 29497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:37:54.473352 29497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:39865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:39865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:54.474426 29497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:54.475454 29497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:54.484475 29503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:54.484553 29497 server_base.cc:1034] running on GCE node
W20260807 22:37:54.484568 29502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:54.484470 29505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:54.485323 29497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:54.486469 29497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:54.487643 29497 hybrid_clock.cc:648] HybridClock initialized: now 1786142274487625 us; error 30 us; skew 500 ppm
Aug 07 22:37:54 dist-test-slave-8w9v krb5kdc[29483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142274, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:54.490376 29497 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:37:54.491223 29497 webserver.cc:460] Webserver started at http://127.26.52.126:42975/ using document root <none> and password file <none>
I20260807 22:37:54.491801 29497 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:54.491890 29497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:54.492195 29497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:54.494235 29497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "a31c3075e7d8450884045706d4a22943"
format_stamp: "Formatted at 2026-08-07 22:37:54 on dist-test-slave-8w9v"
server_key: "0c6c8bf474d354924cca128e8dec2bd4"
server_key_iv: "27307ce6b64d30ee4eba7d7772899313"
server_key_version: "encryptionkey@0"
I20260807 22:37:54.494809 29497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "a31c3075e7d8450884045706d4a22943"
format_stamp: "Formatted at 2026-08-07 22:37:54 on dist-test-slave-8w9v"
server_key: "0c6c8bf474d354924cca128e8dec2bd4"
server_key_iv: "27307ce6b64d30ee4eba7d7772899313"
server_key_version: "encryptionkey@0"
I20260807 22:37:54.498565 29497 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 22:37:54.500903 29513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:54.502034 29497 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:37:54.502183 29497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "a31c3075e7d8450884045706d4a22943"
format_stamp: "Formatted at 2026-08-07 22:37:54 on dist-test-slave-8w9v"
server_key: "0c6c8bf474d354924cca128e8dec2bd4"
server_key_iv: "27307ce6b64d30ee4eba7d7772899313"
server_key_version: "encryptionkey@0"
I20260807 22:37:54.502295 29497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:54.531519 29497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:54.534360 29497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:54.534569 29497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:54.541489 29497 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:39865
I20260807 22:37:54.541507 29569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:39865 every 8 connection(s)
I20260807 22:37:54.542469 29497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:37:54.545210 29570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:54.548237 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 29497
I20260807 22:37:54.548348 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:37:54.548659 26833 external_mini_cluster.cc:1428] Setting key 2646a1de5ef97eb866e038a4a7c601fe
I20260807 22:37:54.551070 29570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943: Bootstrap starting.
I20260807 22:37:54.553519 29570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:54.554445 29570 log.cc:824] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:54.556731 29570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943: No bootstrap required, opened a new log
Aug 07 22:37:54 dist-test-slave-8w9v krb5kdc[29483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:54.560312 29570 raft_consensus.cc:348] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c3075e7d8450884045706d4a22943" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39865 } }
I20260807 22:37:54.560510 29570 raft_consensus.cc:374] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:54.560578 29570 raft_consensus.cc:729] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a31c3075e7d8450884045706d4a22943, State: Initialized, Role: FOLLOWER
I20260807 22:37:54.561004 29570 consensus_queue.cc:260] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c3075e7d8450884045706d4a22943" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39865 } }
I20260807 22:37:54.561170 29570 raft_consensus.cc:388] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:37:54.561251 29570 raft_consensus.cc:482] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:37:54.561373 29570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:54.562214 29570 raft_consensus.cc:504] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c3075e7d8450884045706d4a22943" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39865 } }
I20260807 22:37:54.562541 29570 leader_election.cc:302] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a31c3075e7d8450884045706d4a22943; no voters:
I20260807 22:37:54.562865 29570 leader_election.cc:288] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:37:54.562928 29575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:54.563133 29575 raft_consensus.cc:686] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [term 1 LEADER]: Becoming Leader. State: Replica: a31c3075e7d8450884045706d4a22943, State: Running, Role: LEADER
I20260807 22:37:54.563306 29573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:54.550042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38270 (local address 127.26.52.126:39865)
0807 22:37:54.550433 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:54.550449 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:54.550484 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:37:54.551108 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:54.551149 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:54.551487 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:54.551741 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:54.552664 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:54.553693 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:54.554880 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:54.555473 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:54.555602 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:54.558383 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:54.558388 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:54.558400 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:54.558431 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:54.560192 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:54.560664 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:54.560670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:54.560675 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:54.560815 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:54.561097 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:54.561102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:54.561104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:54.561600 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:54.561801 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:54.562108 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 22:37:54.562402 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":123,"threads_started":1}
I20260807 22:37:54.563491 29575 consensus_queue.cc:237] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c3075e7d8450884045706d4a22943" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39865 } }
I20260807 22:37:54.564143 29570 sys_catalog.cc:564] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:37:54.565266 29576 sys_catalog.cc:455] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a31c3075e7d8450884045706d4a22943. Latest consensus state: current_term: 1 leader_uuid: "a31c3075e7d8450884045706d4a22943" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c3075e7d8450884045706d4a22943" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39865 } } }
I20260807 22:37:54.565397 29576 sys_catalog.cc:458] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:54.565626 29576 sys_catalog.cc:455] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a31c3075e7d8450884045706d4a22943" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a31c3075e7d8450884045706d4a22943" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39865 } } }
I20260807 22:37:54.565711 29576 sys_catalog.cc:458] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943 [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:54.566740 29586 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:37:54.569438 29586 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:37:54.574922 29586 catalog_manager.cc:1347] Generated new cluster ID: 3acc819ea43c406e9be6b7194f7d2d13
I20260807 22:37:54.574993 29586 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:37:54.583982 29586 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:37:54.584867 29586 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:37:54.602041 29586 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a31c3075e7d8450884045706d4a22943: Generated new TSK 0
I20260807 22:37:54.602716 29586 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:37:54.632381 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39865
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:39713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:54.744277 29598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:54.744511 29598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:54.744582 29598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:54.748636 29598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:54.748689 29598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:54.748803 29598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:37:54.754127 29598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:54.755162 29598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:54.756224 29598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:54.766399 29604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:54.766402 29606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:54.766455 29598 server_base.cc:1034] running on GCE node
W20260807 22:37:54.766389 29603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:54.767055 29598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:54.767783 29598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:54.768967 29598 hybrid_clock.cc:648] HybridClock initialized: now 1786142274768953 us; error 25 us; skew 500 ppm
Aug 07 22:37:54 dist-test-slave-8w9v krb5kdc[29483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142274, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:54.771839 29598 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:37:54.772723 29598 webserver.cc:460] Webserver started at http://127.26.52.65:33319/ using document root <none> and password file <none>
I20260807 22:37:54.773267 29598 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:54.773324 29598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:54.773485 29598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:54.775548 29598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "9d2d52119bf54cfab311cc4c69b16a31"
format_stamp: "Formatted at 2026-08-07 22:37:54 on dist-test-slave-8w9v"
server_key: "8ed133cdc7bfd0529beb22183d1abc36"
server_key_iv: "bafa732dcbe1e5d209350fd8e7c66d0c"
server_key_version: "encryptionkey@0"
I20260807 22:37:54.776072 29598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "9d2d52119bf54cfab311cc4c69b16a31"
format_stamp: "Formatted at 2026-08-07 22:37:54 on dist-test-slave-8w9v"
server_key: "8ed133cdc7bfd0529beb22183d1abc36"
server_key_iv: "bafa732dcbe1e5d209350fd8e7c66d0c"
server_key_version: "encryptionkey@0"
I20260807 22:37:54.779657 29598 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:37:54.782013 29616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:54.783216 29598 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:37:54.783346 29598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "9d2d52119bf54cfab311cc4c69b16a31"
format_stamp: "Formatted at 2026-08-07 22:37:54 on dist-test-slave-8w9v"
server_key: "8ed133cdc7bfd0529beb22183d1abc36"
server_key_iv: "bafa732dcbe1e5d209350fd8e7c66d0c"
server_key_version: "encryptionkey@0"
I20260807 22:37:54.783468 29598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:54.808849 29598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:54.812175 29598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:54.812387 29598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:54.812986 29598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:54.813831 29598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:54.813908 29598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:54.813980 29598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:54.814026 29598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:54.822598 29598 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:43737
I20260807 22:37:54.822662 29742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:43737 every 8 connection(s)
I20260807 22:37:54.823523 29598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:37:54.829054 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 29598
I20260807 22:37:54.829181 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:37:54.829485 26833 external_mini_cluster.cc:1428] Setting key a4fb19e7ed95fa78b1c108321730961c
Aug 07 22:37:54 dist-test-slave-8w9v krb5kdc[29483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142274, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:54.837546 29573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:54.825329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:58331 (local address 127.26.52.126:39865)
0807 22:37:54.825494 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:54.825498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:54.826451 (+ 953us) server_negotiation.cc:407] Connection header received
0807 22:37:54.827336 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:54.827340 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:54.827403 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:54.827507 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:54.828731 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:54.829367 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:54.830718 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:54.831033 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:54.831119 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:54.833822 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:54.833828 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:54.833830 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:54.833859 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:54.835361 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:54.835932 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:54.835938 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:54.835954 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:54.836062 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:54.836432 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:54.836436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:54.836437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:54.836626 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:54.836729 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:54.837239 (+ 510us) server_negotiation.cc:299] Negotiation successful
0807 22:37:54.837364 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:37:54.838284 29745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:54.825661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:39865 (local address 127.26.52.65:58331)
0807 22:37:54.826291 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:54.826330 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:54.827129 (+ 799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:54.827688 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:54.827694 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:54.828044 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:54.828575 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:54.828588 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:54.829512 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:54.829515 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:54.830544 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:54.830553 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:54.831187 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:54.831191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:54.831394 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:54.831991 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:54.832016 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:54.833632 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:54.835489 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:54.835495 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:54.835509 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:54.835826 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:54.836179 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:54.836184 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:54.836186 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:54.836325 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:54.836741 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:54.836750 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:54.836985 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 22:37:54.837181 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 22:37:54.837492 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":108,"threads_started":1}
I20260807 22:37:54.839473 29743 heartbeater.cc:347] Connected to a master server at 127.26.52.126:39865
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:37:54.839726 29743 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:54.840328 29743 heartbeater.cc:511] Master 127.26.52.126:39865 requested a full tablet report, sending...
I20260807 22:37:54.841859 29530 ts_manager.cc:194] Registered new tserver with Master: 9d2d52119bf54cfab311cc4c69b16a31 (127.26.52.65:43737)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:37:54.843362 29530 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:58331
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:37:54.856978 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39865
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:39713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:54.967020 29749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:54.967288 29749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:54.967370 29749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:54.971387 29749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:54.971483 29749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:54.971570 29749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:37:54.976915 29749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:54.978019 29749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:54.979056 29749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:54.988754 29754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:54.988816 29755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:54.988756 29757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:54.989202 29749 server_base.cc:1034] running on GCE node
I20260807 22:37:54.989600 29749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:54.990237 29749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:54.991396 29749 hybrid_clock.cc:648] HybridClock initialized: now 1786142274991367 us; error 43 us; skew 500 ppm
Aug 07 22:37:54 dist-test-slave-8w9v krb5kdc[29483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142274, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:54.994179 29749 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:37:54.995008 29749 webserver.cc:460] Webserver started at http://127.26.52.66:39019/ using document root <none> and password file <none>
I20260807 22:37:54.995564 29749 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:54.995623 29749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:54.995867 29749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:54.997999 29749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "ff54b8ef0a5a414db2f34c7003c21f9b"
format_stamp: "Formatted at 2026-08-07 22:37:54 on dist-test-slave-8w9v"
server_key: "86bb08639c0f2812cb66507fdfcea73c"
server_key_iv: "4292fa43e00cade873de9acebba30dd2"
server_key_version: "encryptionkey@0"
I20260807 22:37:54.998572 29749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "ff54b8ef0a5a414db2f34c7003c21f9b"
format_stamp: "Formatted at 2026-08-07 22:37:54 on dist-test-slave-8w9v"
server_key: "86bb08639c0f2812cb66507fdfcea73c"
server_key_iv: "4292fa43e00cade873de9acebba30dd2"
server_key_version: "encryptionkey@0"
I20260807 22:37:55.002553 29749 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:37:55.005035 29764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:55.006326 29749 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:55.006457 29749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "ff54b8ef0a5a414db2f34c7003c21f9b"
format_stamp: "Formatted at 2026-08-07 22:37:54 on dist-test-slave-8w9v"
server_key: "86bb08639c0f2812cb66507fdfcea73c"
server_key_iv: "4292fa43e00cade873de9acebba30dd2"
server_key_version: "encryptionkey@0"
I20260807 22:37:55.006563 29749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:55.025676 29749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:55.028869 29749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:55.029109 29749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:55.029759 29749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:55.030650 29749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:55.030697 29749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:55.030771 29749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:55.030805 29749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:55.039731 29749 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:44841
I20260807 22:37:55.039753 29883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:44841 every 8 connection(s)
I20260807 22:37:55.040650 29749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:37:55.042788 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 29749
I20260807 22:37:55.042914 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:37:55.043237 26833 external_mini_cluster.cc:1428] Setting key ac912249b6250238e14c7a55f5e48d16
Aug 07 22:37:55 dist-test-slave-8w9v krb5kdc[29483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142274, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:37:55.054579 29573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:55.042520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:34461 (local address 127.26.52.126:39865)
0807 22:37:55.042692 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:55.042697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:55.044015 (+ 1318us) server_negotiation.cc:407] Connection header received
0807 22:37:55.045039 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:55.045043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:55.045096 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:55.045184 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:55.046322 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:55.046838 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:55.047966 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:55.048269 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:55.048378 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:55.050822 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:55.050827 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:55.050831 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:55.050862 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:55.052571 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:55.053058 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:55.053063 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:55.053065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:55.053148 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:55.053502 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:55.053506 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:55.053507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:55.053686 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:55.053793 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:55.054265 (+ 472us) server_negotiation.cc:299] Negotiation successful
0807 22:37:55.054395 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:37:55.055413 29886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:55.043051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:39865 (local address 127.26.52.66:34461)
0807 22:37:55.043848 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:55.043908 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:55.044833 (+ 925us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:55.045371 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:55.045378 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:55.045728 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:55.046182 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:55.046195 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:55.046968 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:55.046972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:55.047835 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:55.047844 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:55.048424 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:55.048429 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:55.048594 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:55.049209 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:55.049225 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:55.050651 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:55.052689 (+ 2038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:55.052693 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:55.052704 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:55.052949 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:55.053238 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:55.053240 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:55.053241 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:55.053391 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:55.053792 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:55.053798 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:55.054039 (+ 241us) client_negotiation.cc:769] Sending connection context
0807 22:37:55.054219 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 22:37:55.054522 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":136,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
I20260807 22:37:55.056624 29884 heartbeater.cc:347] Connected to a master server at 127.26.52.126:39865
I20260807 22:37:55.056895 29884 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:55.057376 29884 heartbeater.cc:511] Master 127.26.52.126:39865 requested a full tablet report, sending...
I20260807 22:37:55.058480 29530 ts_manager.cc:194] Registered new tserver with Master: ff54b8ef0a5a414db2f34c7003c21f9b (127.26.52.66:44841)
I20260807 22:37:55.059295 29530 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:34461
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:37:55.071712 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39865
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:39713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:55.182818 29889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:55.183065 29889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:55.183107 29889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:55.187367 29889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:55.187427 29889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:55.187505 29889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:37:55.192848 29889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:55.193909 29889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:55.194933 29889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:55.204417 29898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:55.204464 29896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:55.204468 29895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:55.204651 29889 server_base.cc:1034] running on GCE node
I20260807 22:37:55.205130 29889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:55.205752 29889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:55.206924 29889 hybrid_clock.cc:648] HybridClock initialized: now 1786142275206882 us; error 61 us; skew 500 ppm
Aug 07 22:37:55 dist-test-slave-8w9v krb5kdc[29483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142275, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:55.209717 29889 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:37:55.210536 29889 webserver.cc:460] Webserver started at http://127.26.52.67:39247/ using document root <none> and password file <none>
I20260807 22:37:55.211092 29889 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:55.211154 29889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:55.211364 29889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:55.213370 29889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "cffa527c9b0541d880e642b347f7fb8a"
format_stamp: "Formatted at 2026-08-07 22:37:55 on dist-test-slave-8w9v"
server_key: "09a67aec35c88e6e50f1fe39e8c6e07d"
server_key_iv: "5735034fb44fd9a2eee966eb86ca6b40"
server_key_version: "encryptionkey@0"
I20260807 22:37:55.213874 29889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "cffa527c9b0541d880e642b347f7fb8a"
format_stamp: "Formatted at 2026-08-07 22:37:55 on dist-test-slave-8w9v"
server_key: "09a67aec35c88e6e50f1fe39e8c6e07d"
server_key_iv: "5735034fb44fd9a2eee966eb86ca6b40"
server_key_version: "encryptionkey@0"
I20260807 22:37:55.217406 29889 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:37:55.219620 29905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:55.220818 29889 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:37:55.220942 29889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "cffa527c9b0541d880e642b347f7fb8a"
format_stamp: "Formatted at 2026-08-07 22:37:55 on dist-test-slave-8w9v"
server_key: "09a67aec35c88e6e50f1fe39e8c6e07d"
server_key_iv: "5735034fb44fd9a2eee966eb86ca6b40"
server_key_version: "encryptionkey@0"
I20260807 22:37:55.221040 29889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:55.229902 29889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:55.233098 29889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:55.233292 29889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:55.233889 29889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:55.234716 29889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:55.234772 29889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:55.234874 29889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:55.234912 29889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:55.243630 29889 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:36029
I20260807 22:37:55.243729 30025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:36029 every 8 connection(s)
I20260807 22:37:55.244647 29889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:37:55.248224 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 29889
I20260807 22:37:55.248343 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:37:55.248615 26833 external_mini_cluster.cc:1428] Setting key 238c50c61fe2a4447adbd413c2ecca57
Aug 07 22:37:55 dist-test-slave-8w9v krb5kdc[29483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142275, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:55.258242 29573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:55.246605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:55447 (local address 127.26.52.126:39865)
0807 22:37:55.246747 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:55.246750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:55.247749 (+ 999us) server_negotiation.cc:407] Connection header received
0807 22:37:55.248813 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:55.248817 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:55.248872 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:55.248978 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:55.250475 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:55.251121 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:55.252223 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:55.252440 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:55.252519 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:55.254914 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:55.254917 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:55.254918 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:55.254940 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:55.256330 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:55.256856 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:55.256859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:55.256861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:55.256942 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:55.257274 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:55.257277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:55.257278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:55.257488 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:55.257576 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:55.258016 (+ 440us) server_negotiation.cc:299] Negotiation successful
0807 22:37:55.258118 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:37:55.259068 30028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:55.246976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:39865 (local address 127.26.52.67:55447)
0807 22:37:55.247601 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:55.247642 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:55.248590 (+ 948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:55.249169 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:55.249182 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:55.249742 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:55.250338 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:55.250353 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:55.251237 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:55.251239 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:55.252098 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:55.252107 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:55.252568 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:55.252571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:55.252705 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:55.253326 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:55.253342 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:55.254763 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:55.256437 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:55.256441 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:55.256452 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:55.256758 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:55.257026 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:55.257028 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:55.257030 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:55.257154 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:55.257583 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:55.257588 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:55.257810 (+ 222us) client_negotiation.cc:769] Sending connection context
0807 22:37:55.257962 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 22:37:55.258208 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":101,"threads_started":1}
I20260807 22:37:55.260221 30026 heartbeater.cc:347] Connected to a master server at 127.26.52.126:39865
I20260807 22:37:55.260468 30026 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:55.260969 30026 heartbeater.cc:511] Master 127.26.52.126:39865 requested a full tablet report, sending...
I20260807 22:37:55.262146 29530 ts_manager.cc:194] Registered new tserver with Master: cffa527c9b0541d880e642b347f7fb8a (127.26.52.67:36029)
I20260807 22:37:55.262674 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:37:55.262717 29530 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:55447
W20260807 22:37:55.276333 29573 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:37:55.274913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38278 (local address 127.26.52.126:39865)
0807 22:37:55.275068 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:55.275072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:55.275260 (+ 188us) server_negotiation.cc:407] Connection header received
0807 22:37:55.275370 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:55.275372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:55.275413 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:55.275498 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:55.276222 (+ 724us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38278: BlockingRecv error: recv got EOF from 127.0.0.1:38278 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 22:37:55.277598 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 29598
I20260807 22:37:55.289817 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 29749
I20260807 22:37:55.297940 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 29889
I20260807 22:37:55.305539 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 29497
2026-08-07T22:37:55Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2142 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:37:55 dist-test-slave-8w9v krb5kdc[30039](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:37:55 dist-test-slave-8w9v krb5kdc[30039](info): set up 2 sockets
Aug 07 22:37:55 dist-test-slave-8w9v krb5kdc[30039](info): commencing operation
krb5kdc: starting...
W20260807 22:37:56.387225 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:37:56 dist-test-slave-8w9v krb5kdc[30039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:37:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:37:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:37:56.506798 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:34251
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:41417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:34251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:56.616317 30053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:56.616560 30053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:56.616598 30053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:56.620512 30053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:37:56.620565 30053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:56.620584 30053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:56.620600 30053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:37:56.620615 30053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:37:56.625733 30053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:41417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:34251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:34251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:56.626724 30053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:56.627684 30053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:56.636101 30058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:56.636111 30059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:56.636170 30053 server_base.cc:1034] running on GCE node
W20260807 22:37:56.636335 30061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:56.636863 30053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:56.637846 30053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:56.639041 30053 hybrid_clock.cc:648] HybridClock initialized: now 1786142276639029 us; error 24 us; skew 500 ppm
Aug 07 22:37:56 dist-test-slave-8w9v krb5kdc[30039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142276, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:56.645591 30053 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:37:56.646389 30053 webserver.cc:460] Webserver started at http://127.26.52.126:45031/ using document root <none> and password file <none>
I20260807 22:37:56.646915 30053 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:56.646974 30053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:56.647131 30053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:56.649170 30053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "5153ddc8575b43969ea6bcff4391f88f"
format_stamp: "Formatted at 2026-08-07 22:37:56 on dist-test-slave-8w9v"
server_key: "32d28d01a35d60641ff92cd123f6bc47"
server_key_iv: "8471b0cadb1030aeee8ef464abff0b41"
server_key_version: "encryptionkey@0"
I20260807 22:37:56.649664 30053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "5153ddc8575b43969ea6bcff4391f88f"
format_stamp: "Formatted at 2026-08-07 22:37:56 on dist-test-slave-8w9v"
server_key: "32d28d01a35d60641ff92cd123f6bc47"
server_key_iv: "8471b0cadb1030aeee8ef464abff0b41"
server_key_version: "encryptionkey@0"
I20260807 22:37:56.653210 30053 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 22:37:56.655463 30068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:56.656677 30053 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:37:56.656776 30053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "5153ddc8575b43969ea6bcff4391f88f"
format_stamp: "Formatted at 2026-08-07 22:37:56 on dist-test-slave-8w9v"
server_key: "32d28d01a35d60641ff92cd123f6bc47"
server_key_iv: "8471b0cadb1030aeee8ef464abff0b41"
server_key_version: "encryptionkey@0"
I20260807 22:37:56.656853 30053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:56.684407 30053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:56.687211 30053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:56.687366 30053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:56.695600 30053 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:34251
I20260807 22:37:56.695982 30125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:34251 every 8 connection(s)
I20260807 22:37:56.696769 30053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:37:56.699590 30126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:56.703089 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 30053
I20260807 22:37:56.703212 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:37:56.703522 26833 external_mini_cluster.cc:1428] Setting key 18f8a72b89774a4e35d306fb09dc966d
I20260807 22:37:56.705729 30126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f: Bootstrap starting.
I20260807 22:37:56.708211 30126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:56.708948 30126 log.cc:824] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:56.710769 30126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f: No bootstrap required, opened a new log
Aug 07 22:37:56 dist-test-slave-8w9v krb5kdc[30039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:56.715229 30126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5153ddc8575b43969ea6bcff4391f88f" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34251 } }
I20260807 22:37:56.715548 30126 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:56.715622 30126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5153ddc8575b43969ea6bcff4391f88f, State: Initialized, Role: FOLLOWER
I20260807 22:37:56.716193 30126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5153ddc8575b43969ea6bcff4391f88f" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34251 } }
I20260807 22:37:56.716342 30126 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:37:56.716434 30126 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:37:56.716537 30126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:56.717693 30126 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5153ddc8575b43969ea6bcff4391f88f" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34251 } }
I20260807 22:37:56.718039 30126 leader_election.cc:302] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5153ddc8575b43969ea6bcff4391f88f; no voters:
I20260807 22:37:56.718340 30126 leader_election.cc:288] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:37:56.718448 30132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:56.718555 30129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:56.705011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35726 (local address 127.26.52.126:34251)
0807 22:37:56.705487 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:56.705506 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:56.705547 (+ 41us) server_negotiation.cc:407] Connection header received
0807 22:37:56.706331 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:56.706350 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:56.706681 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:56.706986 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:56.707899 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:56.709029 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:56.710098 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:56.710547 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:56.710715 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:56.713375 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:56.713379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:56.713391 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:56.713416 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:56.715147 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:56.715695 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:56.715704 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:56.715712 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:56.715856 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:56.716194 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:56.716196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:56.716198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:56.716760 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:56.716909 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:56.717279 (+ 370us) server_negotiation.cc:299] Negotiation successful
0807 22:37:56.717635 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":154,"threads_started":1}
I20260807 22:37:56.718659 30132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [term 1 LEADER]: Becoming Leader. State: Replica: 5153ddc8575b43969ea6bcff4391f88f, State: Running, Role: LEADER
I20260807 22:37:56.719595 30126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:37:56.719933 30132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5153ddc8575b43969ea6bcff4391f88f" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34251 } }
I20260807 22:37:56.722069 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:37:56.722173 30134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5153ddc8575b43969ea6bcff4391f88f. Latest consensus state: current_term: 1 leader_uuid: "5153ddc8575b43969ea6bcff4391f88f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5153ddc8575b43969ea6bcff4391f88f" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34251 } } }
I20260807 22:37:56.722781 30134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:56.722400 30133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5153ddc8575b43969ea6bcff4391f88f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5153ddc8575b43969ea6bcff4391f88f" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34251 } } }
I20260807 22:37:56.722985 30133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f [sys.catalog]: This master's current role is: LEADER
W20260807 22:37:56.725085 30146 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:37:56.725172 30146 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:37:56.725250 30147 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:37:56.726310 30147 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:37:56.732704 30147 catalog_manager.cc:1347] Generated new cluster ID: e6b64ad9b6854f3793ff02b4f8931704
I20260807 22:37:56.732762 30147 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:37:56.741449 30129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:56.736645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35732 (local address 127.26.52.126:34251)
0807 22:37:56.736764 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:56.736769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:56.737027 (+ 258us) server_negotiation.cc:407] Connection header received
0807 22:37:56.737255 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:56.737259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:56.737310 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:56.737389 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:56.737897 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:56.738463 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:56.739280 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:56.739564 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:56.739673 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:56.740524 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:56.740528 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:56.740530 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:37:56.740942 (+ 412us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:56.740971 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:37:56.740986 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:56.741084 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:56.741222 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 22:37:56.741281 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":40}
I20260807 22:37:56.754374 30147 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:37:56.755288 30147 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:37:56.759462 30147 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5153ddc8575b43969ea6bcff4391f88f: Generated new TSK 0
I20260807 22:37:56.760278 30147 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:37:56.769721 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 30053
2026-08-07T22:37:56Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1462 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:37:56 dist-test-slave-8w9v krb5kdc[30161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:37:56 dist-test-slave-8w9v krb5kdc[30161](info): set up 2 sockets
Aug 07 22:37:56 dist-test-slave-8w9v krb5kdc[30161](info): commencing operation
krb5kdc: starting...
W20260807 22:37:57.837697 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:37:57 dist-test-slave-8w9v krb5kdc[30161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:37:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:37:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:37:57.958832 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:42951
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:40793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:42951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:58.069079 30176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:58.069422 30176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:58.069497 30176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:58.073398 30176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:37:58.073495 30176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:58.073534 30176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:58.073611 30176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:37:58.073647 30176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:37:58.078684 30176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:40793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:42951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:42951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:58.079777 30176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:58.080811 30176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:37:58.089668 30176 server_base.cc:1034] running on GCE node
W20260807 22:37:58.089730 30185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:58.089941 30183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:58.089968 30182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:58.090577 30176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:58.091660 30176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:58.092847 30176 hybrid_clock.cc:648] HybridClock initialized: now 1786142278092837 us; error 29 us; skew 500 ppm
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142278, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:58.095588 30176 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:37:58.096518 30176 webserver.cc:460] Webserver started at http://127.26.52.126:43759/ using document root <none> and password file <none>
I20260807 22:37:58.097069 30176 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:58.097158 30176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:58.097390 30176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:58.099385 30176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "457311ab834644eb988db6a6c9ca1a84"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "ff9f6c5de79d26399c130bf118c1f3ce"
server_key_iv: "ce1adcf11ae9c13affdd965fa1abca1a"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.099983 30176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "457311ab834644eb988db6a6c9ca1a84"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "ff9f6c5de79d26399c130bf118c1f3ce"
server_key_iv: "ce1adcf11ae9c13affdd965fa1abca1a"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.103749 30176 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:37:58.106200 30192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:58.107410 30176 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:37:58.107571 30176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "457311ab834644eb988db6a6c9ca1a84"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "ff9f6c5de79d26399c130bf118c1f3ce"
server_key_iv: "ce1adcf11ae9c13affdd965fa1abca1a"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.107687 30176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:58.118244 30176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:58.120843 30176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:58.121050 30176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:58.127844 30176 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:42951
I20260807 22:37:58.128196 30247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:42951 every 8 connection(s)
I20260807 22:37:58.128886 30176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:37:58.131548 30249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:37:58.135032 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 30176
I20260807 22:37:58.135180 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:37:58.135448 26833 external_mini_cluster.cc:1428] Setting key d5b54677cdb70c13b63921db32ebd9e4
I20260807 22:37:58.137281 30249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84: Bootstrap starting.
I20260807 22:37:58.139926 30249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84: Neither blocks nor log segments found. Creating new log.
I20260807 22:37:58.140836 30249 log.cc:824] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84: Log is configured to *not* fsync() on all Append() calls
I20260807 22:37:58.142633 30249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84: No bootstrap required, opened a new log
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:58.146176 30249 raft_consensus.cc:348] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "457311ab834644eb988db6a6c9ca1a84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42951 } }
I20260807 22:37:58.146449 30249 raft_consensus.cc:374] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:37:58.146538 30249 raft_consensus.cc:729] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457311ab834644eb988db6a6c9ca1a84, State: Initialized, Role: FOLLOWER
I20260807 22:37:58.146953 30249 consensus_queue.cc:260] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "457311ab834644eb988db6a6c9ca1a84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42951 } }
I20260807 22:37:58.147113 30249 raft_consensus.cc:388] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:37:58.147197 30249 raft_consensus.cc:482] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:37:58.147313 30249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:37:58.148231 30249 raft_consensus.cc:504] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "457311ab834644eb988db6a6c9ca1a84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42951 } }
I20260807 22:37:58.148573 30249 leader_election.cc:302] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 457311ab834644eb988db6a6c9ca1a84; no voters:
I20260807 22:37:58.148876 30249 leader_election.cc:288] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:37:58.148975 30254 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:37:58.149220 30254 raft_consensus.cc:686] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [term 1 LEADER]: Becoming Leader. State: Replica: 457311ab834644eb988db6a6c9ca1a84, State: Running, Role: LEADER
I20260807 22:37:58.149518 30254 consensus_queue.cc:237] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "457311ab834644eb988db6a6c9ca1a84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42951 } }
I20260807 22:37:58.150108 30249 sys_catalog.cc:564] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:37:58.150609 30252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:58.136928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52112 (local address 127.26.52.126:42951)
0807 22:37:58.137345 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:58.137367 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:58.137408 (+ 41us) server_negotiation.cc:407] Connection header received
0807 22:37:58.138202 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:58.138224 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:58.138636 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:58.138986 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:58.139647 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.141189 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.142035 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.142509 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.142681 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:58.145193 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:58.145206 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:58.145218 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:58.145243 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:58.147223 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:58.147727 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:58.147733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:58.147738 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:58.147851 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:58.148157 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:58.148161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:58.148163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:58.148616 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:58.148811 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:58.149407 (+ 596us) server_negotiation.cc:299] Negotiation successful
0807 22:37:58.149702 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":104,"threads_started":1}
I20260807 22:37:58.150697 30254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "457311ab834644eb988db6a6c9ca1a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "457311ab834644eb988db6a6c9ca1a84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42951 } } }
I20260807 22:37:58.150790 30254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:58.151008 30254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 457311ab834644eb988db6a6c9ca1a84. Latest consensus state: current_term: 1 leader_uuid: "457311ab834644eb988db6a6c9ca1a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "457311ab834644eb988db6a6c9ca1a84" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42951 } } }
I20260807 22:37:58.151098 30254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84 [sys.catalog]: This master's current role is: LEADER
I20260807 22:37:58.151347 30263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:37:58.154429 30263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:37:58.159940 30263 catalog_manager.cc:1347] Generated new cluster ID: 06b7007329af4eb59073259c8ade79b8
I20260807 22:37:58.159998 30263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:37:58.168160 30263 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:37:58.169296 30263 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:37:58.185132 30263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 457311ab834644eb988db6a6c9ca1a84: Generated new TSK 0
I20260807 22:37:58.185962 30263 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:37:58.222451 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:42951
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:40793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:58.334688 30280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:58.334918 30280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:58.334959 30280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:58.338923 30280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:58.338973 30280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:58.339046 30280 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:37:58.344055 30280 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:40793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:42951
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:58.345023 30280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:58.345985 30280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:58.355587 30286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:58.355630 30285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:58.355767 30280 server_base.cc:1034] running on GCE node
W20260807 22:37:58.355585 30289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:58.356370 30280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:58.356986 30280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:58.358163 30280 hybrid_clock.cc:648] HybridClock initialized: now 1786142278358151 us; error 29 us; skew 500 ppm
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142278, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:58.360883 30280 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:37:58.361658 30280 webserver.cc:460] Webserver started at http://127.26.52.65:38825/ using document root <none> and password file <none>
I20260807 22:37:58.362195 30280 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:58.362249 30280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:58.362406 30280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:58.364421 30280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "6b50bf3e54c64555886ed6aa541959f3"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "9563c16c113a2b8b6b89ea212341ea0e"
server_key_iv: "ba00e82315dd081b3f6abd9428014f02"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.364900 30280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "6b50bf3e54c64555886ed6aa541959f3"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "9563c16c113a2b8b6b89ea212341ea0e"
server_key_iv: "ba00e82315dd081b3f6abd9428014f02"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.368412 30280 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:37:58.370656 30296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:58.371837 30280 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:37:58.371963 30280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "6b50bf3e54c64555886ed6aa541959f3"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "9563c16c113a2b8b6b89ea212341ea0e"
server_key_iv: "ba00e82315dd081b3f6abd9428014f02"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.372073 30280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:58.390332 30280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:58.393831 30280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:58.394002 30280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:58.394567 30280 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:58.395512 30280 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:58.395582 30280 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:58.395653 30280 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:58.395701 30280 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:58.404884 30280 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:45853
I20260807 22:37:58.404904 30427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:45853 every 8 connection(s)
I20260807 22:37:58.405797 30280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:37:58.408720 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 30280
I20260807 22:37:58.408854 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:37:58.409144 26833 external_mini_cluster.cc:1428] Setting key bf49eb463b1001a141a3c00b096bc024
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142278, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:37:58.420236 30252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:58.407612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:51455 (local address 127.26.52.126:42951)
0807 22:37:58.407755 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:58.407759 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:58.408646 (+ 887us) server_negotiation.cc:407] Connection header received
0807 22:37:58.410141 (+ 1495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:58.410145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:58.410198 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:58.410321 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:58.411718 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.412326 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.413457 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.413687 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.413798 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:58.416392 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:58.416400 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:58.416405 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:58.416452 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:58.418108 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:58.418632 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:58.418638 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:58.418641 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:58.418738 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:58.419074 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:58.419078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:58.419080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:58.419350 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:58.419474 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:58.419938 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 22:37:58.420047 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:37:58.421133 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:58.407976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:42951 (local address 127.26.52.65:51455)
0807 22:37:58.408499 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:58.408541 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:58.409937 (+ 1396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:58.410597 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:58.410604 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:58.411005 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:58.411577 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:58.411594 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.412452 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.412455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:58.413329 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:58.413338 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.413840 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.413844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:58.414016 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:58.414624 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:58.414640 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:58.416216 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:58.418241 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:58.418246 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:58.418257 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:58.418522 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:58.418843 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:58.418845 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:58.418846 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:58.418979 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:58.419472 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:58.419477 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:58.419717 (+ 240us) client_negotiation.cc:769] Sending connection context
0807 22:37:58.419875 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 22:37:58.420177 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":167,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:37:58.423871 30428 heartbeater.cc:347] Connected to a master server at 127.26.52.126:42951
I20260807 22:37:58.424181 30428 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:58.424708 30428 heartbeater.cc:511] Master 127.26.52.126:42951 requested a full tablet report, sending...
I20260807 22:37:58.426297 30209 ts_manager.cc:194] Registered new tserver with Master: 6b50bf3e54c64555886ed6aa541959f3 (127.26.52.65:45853)
I20260807 22:37:58.427444 30209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:51455
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:37:58.437065 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:42951
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:40793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:58.546446 30433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:58.546708 30433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:58.546783 30433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:58.550880 30433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:58.550961 30433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:58.551048 30433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:37:58.556253 30433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:40793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:42951
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:58.557233 30433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:58.558208 30433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:58.568078 30438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:58.568081 30441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:58.568058 30439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:58.568358 30433 server_base.cc:1034] running on GCE node
I20260807 22:37:58.568853 30433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:58.569495 30433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:58.570680 30433 hybrid_clock.cc:648] HybridClock initialized: now 1786142278570668 us; error 27 us; skew 500 ppm
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142278, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:58.573417 30433 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:37:58.574265 30433 webserver.cc:460] Webserver started at http://127.26.52.66:43925/ using document root <none> and password file <none>
I20260807 22:37:58.574774 30433 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:58.574832 30433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:58.575078 30433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:58.577210 30433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "f8f575bed8c9444f80795293126482c8"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "877a68cd0961ec9b2146d84e2246b462"
server_key_iv: "268161c26af257327997b66d4078c63e"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.577768 30433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "f8f575bed8c9444f80795293126482c8"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "877a68cd0961ec9b2146d84e2246b462"
server_key_iv: "268161c26af257327997b66d4078c63e"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.581344 30433 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:37:58.583599 30449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:58.584759 30433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:58.584894 30433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "f8f575bed8c9444f80795293126482c8"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "877a68cd0961ec9b2146d84e2246b462"
server_key_iv: "268161c26af257327997b66d4078c63e"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.585014 30433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:58.613044 30433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:58.616395 30433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:58.616600 30433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:58.617194 30433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:58.618017 30433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:58.618085 30433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:58.618155 30433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:58.618206 30433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:58.627384 30433 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:37137
I20260807 22:37:58.627425 30571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:37137 every 8 connection(s)
I20260807 22:37:58.628273 30433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:37:58.633258 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 30433
I20260807 22:37:58.633402 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:37:58.633715 26833 external_mini_cluster.cc:1428] Setting key ad5042e7234bc6b10b6cf264086c9e48
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142278, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:58.641427 30252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:58.629926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:44137 (local address 127.26.52.126:42951)
0807 22:37:58.630066 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:58.630070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:58.630880 (+ 810us) server_negotiation.cc:407] Connection header received
0807 22:37:58.632211 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:58.632214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:58.632260 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:58.632331 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:58.633441 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.633976 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.635110 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.635339 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.635458 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:58.637967 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:58.637970 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:58.637972 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:58.637995 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:58.639403 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:58.639912 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:58.639916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:58.639918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:58.640001 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:58.640365 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:58.640370 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:58.640372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:58.640553 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:58.640663 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:58.641135 (+ 472us) server_negotiation.cc:299] Negotiation successful
0807 22:37:58.641252 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:37:58.642204 30575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:58.630287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:42951 (local address 127.26.52.66:44137)
0807 22:37:58.630727 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:58.630768 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:58.631961 (+ 1193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:58.632483 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:58.632489 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:58.632808 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:58.633275 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:58.633288 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.634102 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.634107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:58.634975 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:58.634985 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.635489 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.635494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:58.635663 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:58.636266 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:58.636281 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:58.637797 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:58.639539 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:58.639544 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:58.639558 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:58.639807 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:58.640095 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:58.640099 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:58.640101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:58.640266 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:58.640661 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:58.640668 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:58.640900 (+ 232us) client_negotiation.cc:769] Sending connection context
0807 22:37:58.641091 (+ 191us) client_negotiation.cc:240] Negotiation successful
0807 22:37:58.641404 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:37:58.643463 30573 heartbeater.cc:347] Connected to a master server at 127.26.52.126:42951
I20260807 22:37:58.643695 30573 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:58.644241 30573 heartbeater.cc:511] Master 127.26.52.126:42951 requested a full tablet report, sending...
I20260807 22:37:58.645253 30209 ts_manager.cc:194] Registered new tserver with Master: f8f575bed8c9444f80795293126482c8 (127.26.52.66:37137)
I20260807 22:37:58.645807 30209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:44137
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:37:58.662509 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:42951
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:40793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:37:58.774063 30579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:37:58.774296 30579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:37:58.774336 30579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:37:58.778419 30579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:37:58.778475 30579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:37:58.778530 30579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:37:58.783542 30579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:40793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:42951
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:37:58.784529 30579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:37:58.785449 30579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:37:58.795153 30587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:58.795194 30589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:37:58.795212 30586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:37:58.795262 30579 server_base.cc:1034] running on GCE node
I20260807 22:37:58.795992 30579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:37:58.796677 30579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:37:58.797835 30579 hybrid_clock.cc:648] HybridClock initialized: now 1786142278797818 us; error 30 us; skew 500 ppm
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142278, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:37:58.800510 30579 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:37:58.801404 30579 webserver.cc:460] Webserver started at http://127.26.52.67:37613/ using document root <none> and password file <none>
I20260807 22:37:58.801985 30579 fs_manager.cc:359] Metadata directory not provided
I20260807 22:37:58.802078 30579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:37:58.802316 30579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:37:58.804431 30579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "bb05243e86df4314ab867ef4d22115e6"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "e0b7347da8b9899be5cc0435c4ed7371"
server_key_iv: "517ec6ba6d634182695974fb4658f0a4"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.805020 30579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "bb05243e86df4314ab867ef4d22115e6"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "e0b7347da8b9899be5cc0435c4ed7371"
server_key_iv: "517ec6ba6d634182695974fb4658f0a4"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.808697 30579 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:37:58.811041 30596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:58.812376 30579 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:37:58.812511 30579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "bb05243e86df4314ab867ef4d22115e6"
format_stamp: "Formatted at 2026-08-07 22:37:58 on dist-test-slave-8w9v"
server_key: "e0b7347da8b9899be5cc0435c4ed7371"
server_key_iv: "517ec6ba6d634182695974fb4658f0a4"
server_key_version: "encryptionkey@0"
I20260807 22:37:58.812621 30579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:37:58.825940 30579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:37:58.828814 30579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:37:58.829026 30579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:37:58.829615 30579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:37:58.830451 30579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:37:58.830520 30579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:58.830592 30579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:37:58.830646 30579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:37:58.839687 30579 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:35493
I20260807 22:37:58.839713 30715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:35493 every 8 connection(s)
I20260807 22:37:58.840638 30579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:37:58.848412 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 30579
I20260807 22:37:58.848544 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:37:58.848829 26833 external_mini_cluster.cc:1428] Setting key ca9d1e578293a3b1cfe62e1feec7595b
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142278, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:58.853766 30252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:58.842361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:44715 (local address 127.26.52.126:42951)
0807 22:37:58.842504 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:58.842508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:58.843504 (+ 996us) server_negotiation.cc:407] Connection header received
0807 22:37:58.844455 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:58.844458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:58.844516 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:58.844625 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:58.845736 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.846269 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.847367 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.847591 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.847702 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:58.850464 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:58.850471 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:58.850473 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:58.850497 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:58.852016 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:58.852517 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:58.852519 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:58.852520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:58.852593 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:58.852893 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:58.852895 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:58.852896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:58.853060 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:58.853133 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:58.853560 (+ 427us) server_negotiation.cc:299] Negotiation successful
0807 22:37:58.853652 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:37:58.854549 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:58.842710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:42951 (local address 127.26.52.67:44715)
0807 22:37:58.843352 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0807 22:37:58.843393 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:37:58.844251 (+ 858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:37:58.844792 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:37:58.844798 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:37:58.845135 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:37:58.845590 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:58.845602 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.846394 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.846398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:58.847241 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:37:58.847250 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.847740 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.847744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:37:58.847908 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:58.848550 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:37:58.848567 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:37:58.850251 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:37:58.852166 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:58.852172 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:58.852182 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:58.852428 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:58.852674 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:37:58.852676 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:37:58.852677 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:37:58.852808 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:37:58.853145 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:37:58.853150 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:37:58.853357 (+ 207us) client_negotiation.cc:769] Sending connection context
0807 22:37:58.853497 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 22:37:58.853724 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":121,"threads_started":1}
I20260807 22:37:58.855643 30716 heartbeater.cc:347] Connected to a master server at 127.26.52.126:42951
I20260807 22:37:58.855877 30716 heartbeater.cc:464] Registering TS with master...
I20260807 22:37:58.856406 30716 heartbeater.cc:511] Master 127.26.52.126:42951 requested a full tablet report, sending...
I20260807 22:37:58.857385 30209 ts_manager.cc:194] Registered new tserver with Master: bb05243e86df4314ab867ef4d22115e6 (127.26.52.67:35493)
I20260807 22:37:58.857939 30209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:44715
I20260807 22:37:58.862618 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142278, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142278, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:37:58.888487 30252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:37:58.880486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52114 (local address 127.26.52.126:42951)
0807 22:37:58.880623 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 22:37:58.880627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:37:58.880818 (+ 191us) server_negotiation.cc:407] Connection header received
0807 22:37:58.880936 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:37:58.880939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:37:58.880979 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:37:58.881052 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:37:58.881728 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.882232 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.882996 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:37:58.883193 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:37:58.883266 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:37:58.885662 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:37:58.885664 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:37:58.885666 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:37:58.885686 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:37:58.886951 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:58.887373 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:58.887375 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:58.887376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:58.887445 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:37:58.887669 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:37:58.887671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:37:58.887672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:37:58.887919 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:37:58.888028 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:37:58.888272 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 22:37:58.888365 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 22:37:58.888952 30209 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52114
I20260807 22:37:58.889816 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 30280
I20260807 22:37:58.901463 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 30433
I20260807 22:37:58.907413 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 30579
I20260807 22:37:58.914819 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 30176
2026-08-07T22:37:58Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2147 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30732](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30732](info): set up 2 sockets
Aug 07 22:37:58 dist-test-slave-8w9v krb5kdc[30732](info): commencing operation
krb5kdc: starting...
W20260807 22:37:59.990077 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:38:00 dist-test-slave-8w9v krb5kdc[30732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:38:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:38:00.110987 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:46705
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:46705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:00.218463 30745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:00.218704 30745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:00.218743 30745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:00.222473 30745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:00.222517 30745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:00.222535 30745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:00.222550 30745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:00.222565 30745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:00.227571 30745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:46705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:46705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:00.228479 30745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:00.229394 30745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:00.237694 30751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:00.237671 30752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:00.237840 30745 server_base.cc:1034] running on GCE node
W20260807 22:38:00.237684 30754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:00.238554 30745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:00.239570 30745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:00.240729 30745 hybrid_clock.cc:648] HybridClock initialized: now 1786142280240702 us; error 38 us; skew 500 ppm
Aug 07 22:38:00 dist-test-slave-8w9v krb5kdc[30732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142280, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:00.243319 30745 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:38:00.244274 30745 webserver.cc:460] Webserver started at http://127.26.52.126:34807/ using document root <none> and password file <none>
I20260807 22:38:00.244831 30745 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:00.244935 30745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:00.245173 30745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:00.247306 30745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "776f7e36a566404190770383f9051109"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "30a8f49136ae0fd8d77f47cc4dff371f"
server_key_iv: "9f88319a7054376a1aa62fae92d91139"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.247872 30745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "776f7e36a566404190770383f9051109"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "30a8f49136ae0fd8d77f47cc4dff371f"
server_key_iv: "9f88319a7054376a1aa62fae92d91139"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.251478 30745 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:38:00.253839 30761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:00.255025 30745 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 22:38:00.255165 30745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "776f7e36a566404190770383f9051109"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "30a8f49136ae0fd8d77f47cc4dff371f"
server_key_iv: "9f88319a7054376a1aa62fae92d91139"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.255273 30745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:00.274748 30745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:00.277832 30745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:00.278050 30745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:00.285442 30745 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:46705
I20260807 22:38:00.285472 30817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:46705 every 8 connection(s)
I20260807 22:38:00.286391 30745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:00.287247 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 30745
I20260807 22:38:00.287370 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:00.287659 26833 external_mini_cluster.cc:1428] Setting key 1a82debb1c8425f2fd556de667d51d35
I20260807 22:38:00.289466 30818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:00.296398 30818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109: Bootstrap starting.
Aug 07 22:38:00 dist-test-slave-8w9v krb5kdc[30732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:00.299211 30818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:00.300036 30818 log.cc:824] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:00.302245 30818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109: No bootstrap required, opened a new log
I20260807 22:38:00.302644 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:00.289086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42392 (local address 127.26.52.126:46705)
0807 22:38:00.289521 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:00.289541 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:00.289582 (+ 41us) server_negotiation.cc:407] Connection header received
0807 22:38:00.290407 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:00.290430 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:00.290804 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:00.291172 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:00.291871 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.293382 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.294200 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.294872 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.295043 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:00.297820 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:00.297825 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:00.297837 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:00.297864 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:00.299674 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:00.300208 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:00.300216 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:00.300224 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:00.300368 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:00.300676 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:00.300682 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:00.300686 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:00.301134 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:00.301284 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:00.301580 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 22:38:00.301883 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":119,"threads_started":1}
I20260807 22:38:00.306222 30818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776f7e36a566404190770383f9051109" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46705 } }
I20260807 22:38:00.306433 30818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:00.306509 30818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 776f7e36a566404190770383f9051109, State: Initialized, Role: FOLLOWER
I20260807 22:38:00.306892 30818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776f7e36a566404190770383f9051109" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46705 } }
I20260807 22:38:00.307029 30818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:00.307091 30818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:00.307199 30818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:00.308077 30818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776f7e36a566404190770383f9051109" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46705 } }
I20260807 22:38:00.308451 30818 leader_election.cc:302] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 776f7e36a566404190770383f9051109; no voters:
I20260807 22:38:00.308763 30818 leader_election.cc:288] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:00.308915 30823 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:00.309178 30823 raft_consensus.cc:686] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [term 1 LEADER]: Becoming Leader. State: Replica: 776f7e36a566404190770383f9051109, State: Running, Role: LEADER
I20260807 22:38:00.309494 30823 consensus_queue.cc:237] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776f7e36a566404190770383f9051109" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46705 } }
I20260807 22:38:00.310016 30818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:00.311185 30825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 776f7e36a566404190770383f9051109. Latest consensus state: current_term: 1 leader_uuid: "776f7e36a566404190770383f9051109" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776f7e36a566404190770383f9051109" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46705 } } }
I20260807 22:38:00.311318 30825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:00.311738 30834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:00.312067 30824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "776f7e36a566404190770383f9051109" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776f7e36a566404190770383f9051109" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46705 } } }
I20260807 22:38:00.312183 30824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:00.314525 30834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:00.320174 30834 catalog_manager.cc:1347] Generated new cluster ID: 848ecbd3f1aa49fcb9afbd64462d0d48
I20260807 22:38:00.320268 30834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:00.337796 30834 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:00.338884 30834 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:00.343844 30834 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 776f7e36a566404190770383f9051109: Generated new TSK 0
I20260807 22:38:00.344612 30834 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:38:00.371003 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46705
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:00.482198 30846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:00.482415 30846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:00.482452 30846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:00.486248 30846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:00.486292 30846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:00.486344 30846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:00.491072 30846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:00.491953 30846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:00.492916 30846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:00.502300 30853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:00.502315 30852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:00.502288 30855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:00.502554 30846 server_base.cc:1034] running on GCE node
I20260807 22:38:00.502933 30846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:00.503542 30846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:00.504695 30846 hybrid_clock.cc:648] HybridClock initialized: now 1786142280504686 us; error 37 us; skew 500 ppm
Aug 07 22:38:00 dist-test-slave-8w9v krb5kdc[30732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142280, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:00.507354 30846 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:38:00.508287 30846 webserver.cc:460] Webserver started at http://127.26.52.65:42891/ using document root <none> and password file <none>
I20260807 22:38:00.508828 30846 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:00.508886 30846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:00.509124 30846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:00.511216 30846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "3f6c9da3b5a249b9ba08677e60b83616"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "b9cd608108cd8cd914c43e98d2286452"
server_key_iv: "45d499c3ae7a28af617c1efc010077c2"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.511821 30846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "3f6c9da3b5a249b9ba08677e60b83616"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "b9cd608108cd8cd914c43e98d2286452"
server_key_iv: "45d499c3ae7a28af617c1efc010077c2"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.515378 30846 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:38:00.517771 30863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:00.518910 30846 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:38:00.519060 30846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "3f6c9da3b5a249b9ba08677e60b83616"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "b9cd608108cd8cd914c43e98d2286452"
server_key_iv: "45d499c3ae7a28af617c1efc010077c2"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.519172 30846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:00.528986 30846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:00.532063 30846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:00.532313 30846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:00.532886 30846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:00.533675 30846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:00.533721 30846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:00.533787 30846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:00.533818 30846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:00.542922 30846 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:33181
I20260807 22:38:00.542946 30986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:33181 every 8 connection(s)
I20260807 22:38:00.543746 30846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:00.547093 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 30846
I20260807 22:38:00.547240 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:38:00.547623 26833 external_mini_cluster.cc:1428] Setting key 93e74aab22e7a6f33eee14b2f8024e78
Aug 07 22:38:00 dist-test-slave-8w9v krb5kdc[30732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142280, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:38:00.558912 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:00.545662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:56461 (local address 127.26.52.126:46705)
0807 22:38:00.545803 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:00.545807 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:00.546571 (+ 764us) server_negotiation.cc:407] Connection header received
0807 22:38:00.548389 (+ 1818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:00.548392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:00.548464 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:00.548567 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:00.550065 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.550592 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.551898 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.552208 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.552320 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:00.555140 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:00.555143 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:00.555145 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:00.555168 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:00.556675 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:00.557307 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:00.557310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:00.557311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:00.557382 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:00.557779 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:00.557781 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:00.557783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:00.557944 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:00.558018 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:00.558683 (+ 665us) server_negotiation.cc:299] Negotiation successful
0807 22:38:00.558791 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:38:00.559793 30989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:00.546012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46705 (local address 127.26.52.65:56461)
0807 22:38:00.546434 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:00.546475 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:00.548192 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:00.548747 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:00.548753 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:00.549124 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:00.549752 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:00.549773 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.550723 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.550729 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:00.551759 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:00.551768 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.552362 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.552366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:00.552530 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:00.553114 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:00.553131 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:00.554966 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:00.556810 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:00.556817 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:00.556834 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:00.557205 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:00.557480 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:00.557487 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:00.557492 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:00.557683 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:00.558053 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:00.558064 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:00.558401 (+ 337us) client_negotiation.cc:769] Sending connection context
0807 22:38:00.558647 (+ 246us) client_negotiation.cc:240] Negotiation successful
0807 22:38:00.558949 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":108,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:38:00.561349 30987 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46705
I20260807 22:38:00.561604 30987 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:00.562206 30987 heartbeater.cc:511] Master 127.26.52.126:46705 requested a full tablet report, sending...
I20260807 22:38:00.563802 30780 ts_manager.cc:194] Registered new tserver with Master: 3f6c9da3b5a249b9ba08677e60b83616 (127.26.52.65:33181)
I20260807 22:38:00.565177 30780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:56461
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:38:00.577103 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46705
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:00.686872 30992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:00.687165 30992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:00.687243 30992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:00.691249 30992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:00.691340 30992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:00.691428 30992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:00.696655 30992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:00.697711 30992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:00.698905 30992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:00.708647 31000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:00.708711 30992 server_base.cc:1034] running on GCE node
W20260807 22:38:00.708634 30998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:00.708636 30997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:00.709322 30992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:00.709946 30992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:00.711123 30992 hybrid_clock.cc:648] HybridClock initialized: now 1786142280711093 us; error 41 us; skew 500 ppm
Aug 07 22:38:00 dist-test-slave-8w9v krb5kdc[30732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142280, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:00.713888 30992 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:38:00.714717 30992 webserver.cc:460] Webserver started at http://127.26.52.66:41297/ using document root <none> and password file <none>
I20260807 22:38:00.715272 30992 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:00.715359 30992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:00.715590 30992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:00.717607 30992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "9269369efad64089b8d078d65f437407"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "8d1a7ad2b3f6e0843f620fd55fc60606"
server_key_iv: "b97c502cf99e3fc7a73fe860cb12a158"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.718168 30992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "9269369efad64089b8d078d65f437407"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "8d1a7ad2b3f6e0843f620fd55fc60606"
server_key_iv: "b97c502cf99e3fc7a73fe860cb12a158"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.721661 30992 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 22:38:00.724010 31007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:00.725145 30992 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:00.725234 30992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "9269369efad64089b8d078d65f437407"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "8d1a7ad2b3f6e0843f620fd55fc60606"
server_key_iv: "b97c502cf99e3fc7a73fe860cb12a158"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.725310 30992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:00.735302 30992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:00.737895 30992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:00.738044 30992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:00.738519 30992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:00.739215 30992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:00.739259 30992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:00.739295 30992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:00.739315 30992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:00.747984 30992 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:41349
I20260807 22:38:00.748013 31133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:41349 every 8 connection(s)
I20260807 22:38:00.748842 30992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:00.753697 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 30992
I20260807 22:38:00.753832 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:38:00.754139 26833 external_mini_cluster.cc:1428] Setting key a73050f899dccaae154825ff75ec2c2c
Aug 07 22:38:00 dist-test-slave-8w9v krb5kdc[30732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142280, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:00.763147 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:00.750500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:48511 (local address 127.26.52.126:46705)
0807 22:38:00.750637 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:00.750641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:00.751364 (+ 723us) server_negotiation.cc:407] Connection header received
0807 22:38:00.752808 (+ 1444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:00.752812 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:00.752875 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:00.752982 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:00.754434 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.755062 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.756454 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.756855 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.756993 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:00.759624 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:00.759627 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:00.759630 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:00.759652 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:00.761156 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:00.761661 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:00.761665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:00.761667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:00.761746 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:00.762075 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:00.762080 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:00.762082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:00.762256 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:00.762362 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:00.762843 (+ 481us) server_negotiation.cc:299] Negotiation successful
0807 22:38:00.762971 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:38:00.763940 31137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:00.750780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46705 (local address 127.26.52.66:48511)
0807 22:38:00.751195 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:00.751247 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:00.752606 (+ 1359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:00.753146 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:00.753152 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:00.753607 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:00.754280 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:00.754299 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.755191 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.755194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:00.756334 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:00.756344 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.757007 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.757009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:00.757139 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:00.757767 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:00.757801 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:00.759459 (+ 1658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:00.761279 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:00.761285 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:00.761299 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:00.761558 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:00.761839 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:00.761843 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:00.761845 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:00.761980 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:00.762362 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:00.762370 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:00.762613 (+ 243us) client_negotiation.cc:769] Sending connection context
0807 22:38:00.762798 (+ 185us) client_negotiation.cc:240] Negotiation successful
0807 22:38:00.763111 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:38:00.765113 31134 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46705
I20260807 22:38:00.765354 31134 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:00.765863 31134 heartbeater.cc:511] Master 127.26.52.126:46705 requested a full tablet report, sending...
I20260807 22:38:00.766891 30780 ts_manager.cc:194] Registered new tserver with Master: 9269369efad64089b8d078d65f437407 (127.26.52.66:41349)
I20260807 22:38:00.767454 30780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:48511
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:38:00.786676 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46705
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:00.901613 31140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:00.901911 31140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:00.901996 31140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:00.906167 31140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:00.906255 31140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:00.906344 31140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:00.911926 31140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:00.913069 31140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:00.914111 31140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:00.924165 31145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:00.924185 31146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:00.924118 31148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:00.924474 31140 server_base.cc:1034] running on GCE node
I20260807 22:38:00.924865 31140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:00.925555 31140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:00.926741 31140 hybrid_clock.cc:648] HybridClock initialized: now 1786142280926728 us; error 24 us; skew 500 ppm
Aug 07 22:38:00 dist-test-slave-8w9v krb5kdc[30732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142280, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:00.929731 31140 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:38:00.930617 31140 webserver.cc:460] Webserver started at http://127.26.52.67:46751/ using document root <none> and password file <none>
I20260807 22:38:00.931154 31140 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:00.931214 31140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:00.931382 31140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:00.933466 31140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "73e87d938e5e44cc9ad17a6517dc5a96"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "ba2e846b4c0d93b6b23bd2bbc87902c0"
server_key_iv: "a59f9f9e406d9d27364000bd961fa0ca"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.934088 31140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "73e87d938e5e44cc9ad17a6517dc5a96"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "ba2e846b4c0d93b6b23bd2bbc87902c0"
server_key_iv: "a59f9f9e406d9d27364000bd961fa0ca"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.937767 31140 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:38:00.940289 31155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:00.941473 31140 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:00.941609 31140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "73e87d938e5e44cc9ad17a6517dc5a96"
format_stamp: "Formatted at 2026-08-07 22:38:00 on dist-test-slave-8w9v"
server_key: "ba2e846b4c0d93b6b23bd2bbc87902c0"
server_key_iv: "a59f9f9e406d9d27364000bd961fa0ca"
server_key_version: "encryptionkey@0"
I20260807 22:38:00.941715 31140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:00.976498 31140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:00.979571 31140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:00.979794 31140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:00.980471 31140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:00.981328 31140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:00.981374 31140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:00.981467 31140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:00.981508 31140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:00.990468 31140 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:45093
I20260807 22:38:00.990494 31282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:45093 every 8 connection(s)
I20260807 22:38:00.991390 31140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:38:00.994148 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 31140
I20260807 22:38:00.994299 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:38:00.994587 26833 external_mini_cluster.cc:1428] Setting key 9004ae416627b99c9811f891e25328ea
Aug 07 22:38:00 dist-test-slave-8w9v krb5kdc[30732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142280, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:01.005282 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:00.993302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:39777 (local address 127.26.52.126:46705)
0807 22:38:00.993447 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:00.993450 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:00.994372 (+ 922us) server_negotiation.cc:407] Connection header received
0807 22:38:00.996181 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:00.996184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:00.996241 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:00.996325 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:00.997575 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.998099 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.999202 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.999409 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.999489 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:01.001970 (+ 2481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:01.001973 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:01.001976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:01.002001 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:01.003446 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:01.003876 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:01.003879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:01.003880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:01.003956 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:01.004318 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:01.004320 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:01.004321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:01.004506 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:01.004597 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:01.005055 (+ 458us) server_negotiation.cc:299] Negotiation successful
0807 22:38:01.005157 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:38:01.006192 31287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:00.993680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46705 (local address 127.26.52.67:39777)
0807 22:38:00.994207 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:00.994262 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:00.995932 (+ 1670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:00.996496 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:00.996503 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:00.996958 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:00.997447 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:00.997460 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.998229 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.998232 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:00.999099 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:00.999108 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:00.999557 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:00.999560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:00.999699 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:01.000254 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:01.000270 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:01.001818 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:01.003543 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:01.003548 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:01.003558 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:01.003795 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:01.004034 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:01.004036 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:01.004037 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:01.004239 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:01.004597 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:01.004601 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:01.004837 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 22:38:01.004992 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 22:38:01.005248 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":158,"threads_started":1}
I20260807 22:38:01.007498 31284 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46705
I20260807 22:38:01.007798 31284 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:01.008440 31284 heartbeater.cc:511] Master 127.26.52.126:46705 requested a full tablet report, sending...
I20260807 22:38:01.009444 30780 ts_manager.cc:194] Registered new tserver with Master: 73e87d938e5e44cc9ad17a6517dc5a96 (127.26.52.67:45093)
I20260807 22:38:01.010069 30780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:39777
I20260807 22:38:01.020599 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 22:38:01 dist-test-slave-8w9v krb5kdc[30732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:38:01 dist-test-slave-8w9v krb5kdc[30732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:38:01.047746 31292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:01.037946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38082 (local address 127.26.52.65:33181)
0807 22:38:01.038283 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:01.038299 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:01.038325 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:38:01.038381 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:01.038386 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:01.038582 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:01.038704 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:01.039408 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:01.040341 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:01.041142 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:01.041495 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:01.041575 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:01.043849 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:01.043858 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:01.043872 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:01.043896 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:01.045969 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:01.046425 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:01.046431 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:01.046433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:01.046516 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:01.046766 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:01.046769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:01.046770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:01.047033 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:01.047204 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:01.047356 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 22:38:01.047524 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":105,"threads_started":1}
Aug 07 22:38:01 dist-test-slave-8w9v krb5kdc[30732](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:01.058323 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:01.050608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42394 (local address 127.26.52.126:46705)
0807 22:38:01.050759 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:01.050763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:01.050778 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:38:01.050888 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:01.050890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:01.050933 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:01.051000 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:01.051557 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:01.052054 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:01.052806 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:01.053008 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:01.053082 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:01.055293 (+ 2211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:01.055297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:01.055299 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:01.055326 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:01.056664 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:01.057086 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:01.057089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:01.057090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:01.057162 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:01.057442 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:01.057450 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:01.057451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:01.057657 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:01.057796 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:01.058040 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 22:38:01.058160 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 22:38:01.058754 30780 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42394
I20260807 22:38:01.059495 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 30846
I20260807 22:38:01.069733 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 30992
I20260807 22:38:01.076396 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 31140
I20260807 22:38:01.083042 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 30745
2026-08-07T22:38:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2167 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:38:01 dist-test-slave-8w9v krb5kdc[31297](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:38:01 dist-test-slave-8w9v krb5kdc[31297](info): set up 2 sockets
Aug 07 22:38:01 dist-test-slave-8w9v krb5kdc[31297](info): commencing operation
krb5kdc: starting...
W20260807 22:38:02.182555 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:38:02 dist-test-slave-8w9v krb5kdc[31297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:38:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:38:02.312397 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:36349
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:44541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:36349
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:02.426570 31311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:02.426880 31311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:02.426978 31311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:02.431128 31311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:02.431218 31311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:02.431257 31311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:02.431308 31311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:02.431348 31311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:02.437295 31311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:36349
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:36349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:02.438395 31311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:02.439425 31311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:02.447880 31320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:02.447937 31318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:02.447875 31317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:02.448285 31311 server_base.cc:1034] running on GCE node
I20260807 22:38:02.448837 31311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:02.450033 31311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:02.451228 31311 hybrid_clock.cc:648] HybridClock initialized: now 1786142282451213 us; error 27 us; skew 500 ppm
Aug 07 22:38:02 dist-test-slave-8w9v krb5kdc[31297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142282, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:02.453992 31311 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:38:02.454769 31311 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:02.454866 31311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:02.455118 31311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:02.457262 31311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "47b74cb8f1054a018f2a6bddb1baa678"
format_stamp: "Formatted at 2026-08-07 22:38:02 on dist-test-slave-8w9v"
server_key: "72176cedef7a9587783a0aff178e0b2f"
server_key_iv: "28171010e3356ff3fe407ab7201aa85b"
server_key_version: "encryptionkey@0"
I20260807 22:38:02.457823 31311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "47b74cb8f1054a018f2a6bddb1baa678"
format_stamp: "Formatted at 2026-08-07 22:38:02 on dist-test-slave-8w9v"
server_key: "72176cedef7a9587783a0aff178e0b2f"
server_key_iv: "28171010e3356ff3fe407ab7201aa85b"
server_key_version: "encryptionkey@0"
I20260807 22:38:02.461706 31311 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:38:02.464481 31326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:02.465709 31311 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260807 22:38:02.465852 31311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "47b74cb8f1054a018f2a6bddb1baa678"
format_stamp: "Formatted at 2026-08-07 22:38:02 on dist-test-slave-8w9v"
server_key: "72176cedef7a9587783a0aff178e0b2f"
server_key_iv: "28171010e3356ff3fe407ab7201aa85b"
server_key_version: "encryptionkey@0"
I20260807 22:38:02.465975 31311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:02.486763 31311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:02.489559 31311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:02.489781 31311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:02.496877 31311 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:36349
I20260807 22:38:02.497156 31389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:36349 every 8 connection(s)
I20260807 22:38:02.497557 31311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:02.499114 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 31311
I20260807 22:38:02.499256 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:02.499533 26833 external_mini_cluster.cc:1428] Setting key 583d46c7c550bfad521020d53da42105
I20260807 22:38:02.500494 31390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:02.506142 31390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678: Bootstrap starting.
Aug 07 22:38:02 dist-test-slave-8w9v krb5kdc[31297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:02.508752 31390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:02.509598 31390 log.cc:824] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:02.511803 31390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678: No bootstrap required, opened a new log
I20260807 22:38:02.513593 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:02.500941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39476 (local address 127.26.52.126:36349)
0807 22:38:02.501374 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:02.501388 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:02.501430 (+ 42us) server_negotiation.cc:407] Connection header received
0807 22:38:02.502068 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:02.502083 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:02.502383 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:02.502714 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:02.503530 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:02.504690 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:02.505551 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:02.506043 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:02.506213 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:02.508932 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:02.508938 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:02.508950 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:02.508976 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:02.510798 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:02.511281 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:02.511285 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:02.511289 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:02.511391 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:02.511697 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:02.511699 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:02.511700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:02.512157 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:02.512315 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:02.512594 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 22:38:02.512882 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":137,"threads_started":1}
I20260807 22:38:02.516000 31390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b74cb8f1054a018f2a6bddb1baa678" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36349 } }
I20260807 22:38:02.516258 31390 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:02.516333 31390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b74cb8f1054a018f2a6bddb1baa678, State: Initialized, Role: FOLLOWER
I20260807 22:38:02.516723 31390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b74cb8f1054a018f2a6bddb1baa678" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36349 } }
I20260807 22:38:02.516860 31390 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:02.516924 31390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:02.517012 31390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:02.517908 31390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b74cb8f1054a018f2a6bddb1baa678" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36349 } }
I20260807 22:38:02.518239 31390 leader_election.cc:302] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47b74cb8f1054a018f2a6bddb1baa678; no voters:
I20260807 22:38:02.518548 31390 leader_election.cc:288] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:02.518647 31395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:02.518882 31395 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [term 1 LEADER]: Becoming Leader. State: Replica: 47b74cb8f1054a018f2a6bddb1baa678, State: Running, Role: LEADER
I20260807 22:38:02.519244 31395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b74cb8f1054a018f2a6bddb1baa678" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36349 } }
I20260807 22:38:02.519757 31390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:02.521090 31396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47b74cb8f1054a018f2a6bddb1baa678" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b74cb8f1054a018f2a6bddb1baa678" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36349 } } }
I20260807 22:38:02.521086 31397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47b74cb8f1054a018f2a6bddb1baa678. Latest consensus state: current_term: 1 leader_uuid: "47b74cb8f1054a018f2a6bddb1baa678" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b74cb8f1054a018f2a6bddb1baa678" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36349 } } }
I20260807 22:38:02.521260 31396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:02.521262 31397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:02.521688 31406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:02.524516 31406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:02.529589 31406 catalog_manager.cc:1347] Generated new cluster ID: 866439f5106e40f19aaacc8a5fb7a11b
I20260807 22:38:02.529697 31406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:02.548714 31406 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:02.549614 31406 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:02.557277 31406 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678: Generated new TSK 0
I20260807 22:38:02.557962 31406 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:38:02.588716 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36349
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:44541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:02.699244 31420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:02.699498 31420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:02.699543 31420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:02.703384 31420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:02.703429 31420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:02.703485 31420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:02.709211 31420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:02.710170 31420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:02.711213 31420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:02.720983 31425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:02.720979 31430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:02.720979 31426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:02.721200 31420 server_base.cc:1034] running on GCE node
I20260807 22:38:02.721801 31420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:02.722430 31420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:02.723618 31420 hybrid_clock.cc:648] HybridClock initialized: now 1786142282723604 us; error 24 us; skew 500 ppm
Aug 07 22:38:02 dist-test-slave-8w9v krb5kdc[31297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142282, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:02.726375 31420 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:38:02.727087 31420 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:02.727185 31420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:02.727427 31420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:02.729497 31420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "4eb4dccce20d4a2a83e0e0addd534bfe"
format_stamp: "Formatted at 2026-08-07 22:38:02 on dist-test-slave-8w9v"
server_key: "c64d4a6608ce19585b031aee036cfd9c"
server_key_iv: "52b05c9d83ed9ff2c0573885ef070dbf"
server_key_version: "encryptionkey@0"
I20260807 22:38:02.730053 31420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "4eb4dccce20d4a2a83e0e0addd534bfe"
format_stamp: "Formatted at 2026-08-07 22:38:02 on dist-test-slave-8w9v"
server_key: "c64d4a6608ce19585b031aee036cfd9c"
server_key_iv: "52b05c9d83ed9ff2c0573885ef070dbf"
server_key_version: "encryptionkey@0"
I20260807 22:38:02.733741 31420 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 22:38:02.736047 31437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:02.737257 31420 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:02.737416 31420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "4eb4dccce20d4a2a83e0e0addd534bfe"
format_stamp: "Formatted at 2026-08-07 22:38:02 on dist-test-slave-8w9v"
server_key: "c64d4a6608ce19585b031aee036cfd9c"
server_key_iv: "52b05c9d83ed9ff2c0573885ef070dbf"
server_key_version: "encryptionkey@0"
I20260807 22:38:02.737532 31420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:02.757089 31420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:02.760908 31420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:02.761116 31420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:02.761740 31420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:02.762611 31420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:02.762660 31420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:02.762732 31420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:02.762763 31420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:02.774483 31420 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:46293
I20260807 22:38:02.774499 31558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:46293 every 8 connection(s)
I20260807 22:38:02.775259 31420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
Aug 07 22:38:02 dist-test-slave-8w9v krb5kdc[31297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142282, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:02.785105 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 31420
I20260807 22:38:02.785250 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:38:02.785605 26833 external_mini_cluster.cc:1428] Setting key ec67604c22e43372712930c42946d7b6
I20260807 22:38:02.788869 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:02.777357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:39635 (local address 127.26.52.126:36349)
0807 22:38:02.777538 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:02.777544 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:02.778701 (+ 1157us) server_negotiation.cc:407] Connection header received
0807 22:38:02.779502 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:02.779504 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:02.779554 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:02.779646 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:02.780797 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:02.781369 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:02.782528 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:02.782754 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:02.782839 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:02.785241 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:02.785244 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:02.785246 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:02.785270 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:02.786748 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:02.787258 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:02.787263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:02.787265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:02.787348 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:02.787711 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:02.787716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:02.787718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:02.787901 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:02.788014 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:02.788572 (+ 558us) server_negotiation.cc:299] Negotiation successful
0807 22:38:02.788699 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 22:38:02.789742 31561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:02.777770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:36349 (local address 127.26.52.65:39635)
0807 22:38:02.778562 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:02.778602 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:02.779329 (+ 727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:02.779776 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:02.779782 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:02.780183 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:02.780661 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:02.780674 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:02.781498 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:02.781502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:02.782353 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:02.782362 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:02.782881 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:02.782884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:02.783023 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:02.783537 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:02.783552 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:02.785037 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:02.786874 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:02.786880 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:02.786894 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:02.787154 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:02.787452 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:02.787456 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:02.787458 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:02.787601 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:02.788012 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:02.788019 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:02.788328 (+ 309us) client_negotiation.cc:769] Sending connection context
0807 22:38:02.788517 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 22:38:02.788833 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":115,"threads_started":1}
I20260807 22:38:02.790967 31559 heartbeater.cc:347] Connected to a master server at 127.26.52.126:36349
I20260807 22:38:02.791213 31559 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:02.791728 31559 heartbeater.cc:511] Master 127.26.52.126:36349 requested a full tablet report, sending...
I20260807 22:38:02.793476 31349 ts_manager.cc:194] Registered new tserver with Master: 4eb4dccce20d4a2a83e0e0addd534bfe (127.26.52.65:46293)
I20260807 22:38:02.795148 31349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:39635
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:38:02.815021 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36349
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:44541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:02.925724 31565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:02.925992 31565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:02.926069 31565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:02.930100 31565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:02.930191 31565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:02.930285 31565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:02.935513 31565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:02.936652 31565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:02.937667 31565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:02.947043 31573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:02.947088 31570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:02.947100 31571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:02.947304 31565 server_base.cc:1034] running on GCE node
I20260807 22:38:02.947840 31565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:02.948504 31565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:02.949688 31565 hybrid_clock.cc:648] HybridClock initialized: now 1786142282949671 us; error 27 us; skew 500 ppm
Aug 07 22:38:02 dist-test-slave-8w9v krb5kdc[31297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142282, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:02.952472 31565 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:38:02.953193 31565 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:02.953293 31565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:02.953522 31565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:02.955534 31565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "62c8178399774156acea65f07b06a3da"
format_stamp: "Formatted at 2026-08-07 22:38:02 on dist-test-slave-8w9v"
server_key: "5a871792a689321d6d61d480d36a99cb"
server_key_iv: "a60e57b8ba4a0bb73905091d5a0eda70"
server_key_version: "encryptionkey@0"
I20260807 22:38:02.956190 31565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "62c8178399774156acea65f07b06a3da"
format_stamp: "Formatted at 2026-08-07 22:38:02 on dist-test-slave-8w9v"
server_key: "5a871792a689321d6d61d480d36a99cb"
server_key_iv: "a60e57b8ba4a0bb73905091d5a0eda70"
server_key_version: "encryptionkey@0"
I20260807 22:38:02.959878 31565 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:38:02.962263 31579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:02.963429 31565 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:02.963562 31565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "62c8178399774156acea65f07b06a3da"
format_stamp: "Formatted at 2026-08-07 22:38:02 on dist-test-slave-8w9v"
server_key: "5a871792a689321d6d61d480d36a99cb"
server_key_iv: "a60e57b8ba4a0bb73905091d5a0eda70"
server_key_version: "encryptionkey@0"
I20260807 22:38:02.963666 31565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:02.974818 31565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:02.978061 31565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:02.978259 31565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:02.978847 31565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:02.979681 31565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:02.979750 31565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:02.979820 31565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:02.979878 31565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:02.988984 31565 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:41817
I20260807 22:38:02.989008 31703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:41817 every 8 connection(s)
I20260807 22:38:02.989563 31565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:02.991212 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 31565
I20260807 22:38:02.991343 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:38:02.991670 26833 external_mini_cluster.cc:1428] Setting key 70ad3db88ca31837474bfeaaf940b3e1
Aug 07 22:38:02 dist-test-slave-8w9v krb5kdc[31297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142282, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:38:03.003644 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:02.991312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:39539 (local address 127.26.52.126:36349)
0807 22:38:02.991456 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:02.991460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:02.992517 (+ 1057us) server_negotiation.cc:407] Connection header received
0807 22:38:02.993935 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:02.993939 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:02.993993 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:02.994072 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:02.995342 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:02.995861 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:02.997229 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:02.997474 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:02.997590 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:02.999986 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:02.999990 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:02.999992 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:03.000024 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:03.001614 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:03.002111 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:03.002116 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:03.002118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:03.002198 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:03.002553 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:03.002558 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:03.002560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:03.002742 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:03.002853 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.003341 (+ 488us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.003466 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
I20260807 22:38:03.004676 31706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:02.991743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:36349 (local address 127.26.52.66:39539)
0807 22:38:02.992335 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:02.992389 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:02.993720 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:02.994239 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:02.994247 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:02.994590 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:02.995173 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:02.995195 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:02.996010 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:02.996015 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:02.997097 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:02.997107 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:02.997627 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:02.997632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:02.997812 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:02.998410 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:02.998426 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:02.999824 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:03.001729 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:03.001735 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:03.001757 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:03.002005 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:03.002311 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:03.002314 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:03.002316 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:03.002455 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:03.002851 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:03.002858 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:03.003100 (+ 242us) client_negotiation.cc:769] Sending connection context
0807 22:38:03.003295 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 22:38:03.003618 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":151,"threads_started":1}
I20260807 22:38:03.006021 31704 heartbeater.cc:347] Connected to a master server at 127.26.52.126:36349
I20260807 22:38:03.006290 31704 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:03.006750 31704 heartbeater.cc:511] Master 127.26.52.126:36349 requested a full tablet report, sending...
I20260807 22:38:03.007844 31349 ts_manager.cc:194] Registered new tserver with Master: 62c8178399774156acea65f07b06a3da (127.26.52.66:41817)
I20260807 22:38:03.008522 31349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:39539
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:38:03.021553 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36349
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:44541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:03.135690 31709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:03.135941 31709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:03.136029 31709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:03.139940 31709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:03.140012 31709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:03.140103 31709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:03.145256 31709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:03.146219 31709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:03.147255 31709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:03.156490 31718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:03.156556 31716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:03.156850 31715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:03.156876 31709 server_base.cc:1034] running on GCE node
I20260807 22:38:03.157308 31709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:03.157913 31709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:03.159085 31709 hybrid_clock.cc:648] HybridClock initialized: now 1786142283159066 us; error 30 us; skew 500 ppm
Aug 07 22:38:03 dist-test-slave-8w9v krb5kdc[31297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142283, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:03.162019 31709 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:38:03.162717 31709 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:03.162789 31709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:03.162956 31709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:03.165030 31709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "983c28e7f9864cfeb4ec156d0c144ec0"
format_stamp: "Formatted at 2026-08-07 22:38:03 on dist-test-slave-8w9v"
server_key: "bdd9865199ec3f161814dbd78fca1409"
server_key_iv: "717a632a6390b1875c6116834e6d9882"
server_key_version: "encryptionkey@0"
I20260807 22:38:03.165532 31709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "983c28e7f9864cfeb4ec156d0c144ec0"
format_stamp: "Formatted at 2026-08-07 22:38:03 on dist-test-slave-8w9v"
server_key: "bdd9865199ec3f161814dbd78fca1409"
server_key_iv: "717a632a6390b1875c6116834e6d9882"
server_key_version: "encryptionkey@0"
I20260807 22:38:03.169757 31709 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:38:03.172361 31725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:03.173594 31709 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:03.173715 31709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "983c28e7f9864cfeb4ec156d0c144ec0"
format_stamp: "Formatted at 2026-08-07 22:38:03 on dist-test-slave-8w9v"
server_key: "bdd9865199ec3f161814dbd78fca1409"
server_key_iv: "717a632a6390b1875c6116834e6d9882"
server_key_version: "encryptionkey@0"
I20260807 22:38:03.173830 31709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:03.190630 31709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:03.194130 31709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:03.194348 31709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:03.194993 31709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:03.195885 31709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:03.195935 31709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:03.196008 31709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:03.196045 31709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:03.204874 31709 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:40135
I20260807 22:38:03.204895 31847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:40135 every 8 connection(s)
I20260807 22:38:03.205569 31709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:38:03.208346 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 31709
I20260807 22:38:03.208505 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:38:03.208849 26833 external_mini_cluster.cc:1428] Setting key 97f3ac7bb3c6153c323ef1fda5e03e23
Aug 07 22:38:03 dist-test-slave-8w9v krb5kdc[31297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142283, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:03.218819 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.207363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:54003 (local address 127.26.52.126:36349)
0807 22:38:03.207520 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:03.207526 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:03.208986 (+ 1460us) server_negotiation.cc:407] Connection header received
0807 22:38:03.209902 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:03.209905 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:03.209962 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:03.210028 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:03.211192 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.211706 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.212841 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.213054 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.213132 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.215500 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:03.215503 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:03.215505 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:03.215527 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:03.217108 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:03.217553 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:03.217556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:03.217557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:03.217628 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:03.217923 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:03.217925 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:03.217926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:03.218090 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:03.218164 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.218605 (+ 441us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.218699 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:38:03.219878 31850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.207809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:36349 (local address 127.26.52.67:54003)
0807 22:38:03.208825 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:03.208882 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:03.209712 (+ 830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:03.210207 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:03.210213 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:03.210558 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:03.211010 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.211048 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.211810 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.211812 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.212735 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.212744 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.213177 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.213179 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.213313 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.213853 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:03.213868 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:03.215352 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:03.217218 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:03.217222 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:03.217232 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:03.217471 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:03.217704 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:03.217706 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:03.217708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:03.217847 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:03.218176 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:03.218181 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:03.218409 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 22:38:03.218560 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 22:38:03.218793 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":108,"threads_started":1}
I20260807 22:38:03.221103 31848 heartbeater.cc:347] Connected to a master server at 127.26.52.126:36349
I20260807 22:38:03.221359 31848 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:03.221872 31848 heartbeater.cc:511] Master 127.26.52.126:36349 requested a full tablet report, sending...
I20260807 22:38:03.222946 31349 ts_manager.cc:194] Registered new tserver with Master: 983c28e7f9864cfeb4ec156d0c144ec0 (127.26.52.67:40135)
I20260807 22:38:03.223513 31349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:54003
I20260807 22:38:03.234287 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:38:03.244194 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.236289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39484 (local address 127.26.52.126:36349)
0807 22:38:03.236442 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:03.236448 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:03.236617 (+ 169us) server_negotiation.cc:407] Connection header received
0807 22:38:03.236779 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:03.236782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:03.236833 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:03.236914 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:03.237624 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.238143 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.238984 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.239215 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.239323 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.240857 (+ 1534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:03.240861 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:03.240864 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:03.240889 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:03.242466 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:03.242883 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:03.242886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:03.242888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:03.242971 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:03.243244 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:03.243247 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:03.243249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:03.243475 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:03.243622 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.243863 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.243983 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:38:03.246883 31349 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39484:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:38:03.249982 31349 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:38:03.264285 31864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.259012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49666 (local address 127.26.52.66:41817)
0807 22:38:03.259822 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:03.259833 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:03.259862 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:38:03.259937 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:03.259942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:03.260153 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:03.260323 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:03.260523 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.261341 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.262793 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.263577 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.263703 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.263850 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.264004 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.264093 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":712,"thread_start_us":147,"threads_started":1}
I20260807 22:38:03.264283 31861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.258348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:41817 (local address 127.0.0.1:49666)
0807 22:38:03.259394 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:03.259410 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:03.259546 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:03.260293 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:03.260296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:03.260314 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:03.260425 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.260433 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.261486 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.261489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.262685 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.262696 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.263705 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.263708 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.263813 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.263849 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 22:38:03.263962 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:38:03.264084 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":989,"spinlock_wait_cycles":7040,"thread_start_us":135,"threads_started":1}
I20260807 22:38:03.264632 31863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.258262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:40135 (local address 127.0.0.1:50516)
0807 22:38:03.259326 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:03.259379 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:03.259546 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:03.260185 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:03.260191 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:03.260216 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:03.260349 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.260355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.261977 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.261980 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.263146 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.263154 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.264247 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.264251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.264342 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.264362 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 22:38:03.264414 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 22:38:03.264483 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"mutex_wait_us":152,"spinlock_wait_cycles":4224,"thread_start_us":86,"threads_started":1}
I20260807 22:38:03.265133 31865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.259151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50054 (local address 127.26.52.65:46293)
0807 22:38:03.259822 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:03.259831 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:03.260074 (+ 243us) server_negotiation.cc:407] Connection header received
0807 22:38:03.260185 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:03.260190 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:03.260354 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:03.260501 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:03.260776 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.261861 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.263327 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.264082 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.264245 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.264392 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.264883 (+ 491us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.264979 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":113,"threads_started":1}
I20260807 22:38:03.265290 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.258562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50516 (local address 127.26.52.67:40135)
0807 22:38:03.258968 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:03.258981 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:03.259497 (+ 516us) server_negotiation.cc:407] Connection header received
0807 22:38:03.259714 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:03.259721 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:03.259946 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:03.260507 (+ 561us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:03.260651 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.261830 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.263258 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.264062 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.264843 (+ 781us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.264989 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.265035 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.265117 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":167,"threads_started":1}
I20260807 22:38:03.265406 31860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.258966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:46293 (local address 127.0.0.1:50054)
0807 22:38:03.259963 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:03.259976 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:03.260066 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:03.260560 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:03.260565 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:03.260582 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:03.260660 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.260665 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.262033 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.262036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.263222 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.263234 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.264454 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.264458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.264527 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.264547 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 22:38:03.264610 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 22:38:03.264694 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":929,"mutex_wait_us":3,"thread_start_us":106,"threads_started":1}
I20260807 22:38:03.268041 31631 tablet_service.cc:1467] Processing CreateTablet for tablet 2338c77544c0494bba48737768803578 (DEFAULT_TABLE table=test-table [id=517f330c969145db824f03b3c94108d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:03.268040 31776 tablet_service.cc:1467] Processing CreateTablet for tablet 2338c77544c0494bba48737768803578 (DEFAULT_TABLE table=test-table [id=517f330c969145db824f03b3c94108d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:03.269266 31631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2338c77544c0494bba48737768803578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:03.269270 31776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2338c77544c0494bba48737768803578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:03.270633 31487 tablet_service.cc:1467] Processing CreateTablet for tablet 2338c77544c0494bba48737768803578 (DEFAULT_TABLE table=test-table [id=517f330c969145db824f03b3c94108d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:03.271456 31487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2338c77544c0494bba48737768803578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:03.277390 31866 tablet_bootstrap.cc:492] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da: Bootstrap starting.
I20260807 22:38:03.277613 31867 tablet_bootstrap.cc:492] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: Bootstrap starting.
I20260807 22:38:03.278571 31868 tablet_bootstrap.cc:492] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe: Bootstrap starting.
I20260807 22:38:03.279541 31866 tablet_bootstrap.cc:654] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:03.279878 31867 tablet_bootstrap.cc:654] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:03.280591 31868 tablet_bootstrap.cc:654] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:03.280781 31866 log.cc:824] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:03.281077 31867 log.cc:824] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:03.282119 31868 log.cc:824] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:03.283025 31867 tablet_bootstrap.cc:492] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: No bootstrap required, opened a new log
I20260807 22:38:03.283022 31866 tablet_bootstrap.cc:492] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da: No bootstrap required, opened a new log
I20260807 22:38:03.283217 31867 ts_tablet_manager.cc:1397] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:38:03.283217 31866 ts_tablet_manager.cc:1397] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 22:38:03.283779 31868 tablet_bootstrap.cc:492] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe: No bootstrap required, opened a new log
I20260807 22:38:03.283972 31868 ts_tablet_manager.cc:1397] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:38:03.286772 31868 raft_consensus.cc:348] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 } } peers { permanent_uuid: "62c8178399774156acea65f07b06a3da" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 41817 } } peers { permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 } }
I20260807 22:38:03.287145 31868 raft_consensus.cc:374] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:03.287050 31867 raft_consensus.cc:348] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 } } peers { permanent_uuid: "62c8178399774156acea65f07b06a3da" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 41817 } } peers { permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 } }
I20260807 22:38:03.287050 31866 raft_consensus.cc:348] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 } } peers { permanent_uuid: "62c8178399774156acea65f07b06a3da" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 41817 } } peers { permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 } }
I20260807 22:38:03.287248 31868 raft_consensus.cc:729] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eb4dccce20d4a2a83e0e0addd534bfe, State: Initialized, Role: FOLLOWER
I20260807 22:38:03.287304 31866 raft_consensus.cc:374] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:03.287304 31867 raft_consensus.cc:374] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:03.287364 31867 raft_consensus.cc:729] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 983c28e7f9864cfeb4ec156d0c144ec0, State: Initialized, Role: FOLLOWER
I20260807 22:38:03.287392 31866 raft_consensus.cc:729] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62c8178399774156acea65f07b06a3da, State: Initialized, Role: FOLLOWER
I20260807 22:38:03.287746 31868 consensus_queue.cc:260] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 } } peers { permanent_uuid: "62c8178399774156acea65f07b06a3da" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 41817 } } peers { permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 } }
I20260807 22:38:03.287799 31866 consensus_queue.cc:260] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 } } peers { permanent_uuid: "62c8178399774156acea65f07b06a3da" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 41817 } } peers { permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 } }
I20260807 22:38:03.287799 31867 consensus_queue.cc:260] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 } } peers { permanent_uuid: "62c8178399774156acea65f07b06a3da" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 41817 } } peers { permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 } }
I20260807 22:38:03.288411 31559 heartbeater.cc:503] Master 127.26.52.126:36349 was elected leader, sending a full tablet report...
I20260807 22:38:03.288758 31868 ts_tablet_manager.cc:1428] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260807 22:38:03.288766 31866 ts_tablet_manager.cc:1428] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260807 22:38:03.288766 31867 ts_tablet_manager.cc:1428] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 22:38:03.289119 31848 heartbeater.cc:503] Master 127.26.52.126:36349 was elected leader, sending a full tablet report...
I20260807 22:38:03.289156 31704 heartbeater.cc:503] Master 127.26.52.126:36349 was elected leader, sending a full tablet report...
I20260807 22:38:03.404505 31875 raft_consensus.cc:482] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:03.404753 31875 raft_consensus.cc:504] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 } } peers { permanent_uuid: "62c8178399774156acea65f07b06a3da" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 41817 } } peers { permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 } }
I20260807 22:38:03.406629 31875 leader_election.cc:288] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 983c28e7f9864cfeb4ec156d0c144ec0 (127.26.52.67:40135), 4eb4dccce20d4a2a83e0e0addd534bfe (127.26.52.65:46293)
I20260807 22:38:03.410835 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.406577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:41123 (local address 127.26.52.67:40135)
0807 22:38:03.406986 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:03.407026 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:03.407044 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:38:03.407142 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:03.407146 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:03.407298 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:03.407441 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:03.407866 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.408542 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.409839 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.410247 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.410392 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.410448 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.410643 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.410715 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168}
I20260807 22:38:03.410835 31706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.406359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:40135 (local address 127.26.52.66:41123)
0807 22:38:03.406491 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:03.406508 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:03.406614 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:03.407489 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:03.407493 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:03.407513 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:03.407709 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.407718 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.408699 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.408704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.409699 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.409709 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.410385 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.410389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.410504 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.410531 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:38:03.410624 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 22:38:03.410695 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 22:38:03.411073 31865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.407047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:58257 (local address 127.26.52.65:46293)
0807 22:38:03.407171 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:03.407177 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:03.407539 (+ 362us) server_negotiation.cc:407] Connection header received
0807 22:38:03.407804 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:03.407809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:03.407884 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:03.407970 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:03.408257 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.408983 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.410078 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.410499 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.410630 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.410682 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.410868 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.410940 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:38:03.411141 31878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.406908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:46293 (local address 127.26.52.66:58257)
0807 22:38:03.407443 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:03.407458 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:03.407616 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:03.407983 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:03.407986 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:03.408005 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:03.408150 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.408158 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.409124 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.409127 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.409950 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:03.409958 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.410624 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.410627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:03.410732 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.410753 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:38:03.410850 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 22:38:03.411007 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":132,"threads_started":1}
I20260807 22:38:03.411553 31797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2338c77544c0494bba48737768803578" candidate_uuid: "62c8178399774156acea65f07b06a3da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" is_pre_election: true
I20260807 22:38:03.411762 31509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2338c77544c0494bba48737768803578" candidate_uuid: "62c8178399774156acea65f07b06a3da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" is_pre_election: true
I20260807 22:38:03.411904 31797 raft_consensus.cc:2454] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62c8178399774156acea65f07b06a3da in term 0.
I20260807 22:38:03.412029 31509 raft_consensus.cc:2454] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62c8178399774156acea65f07b06a3da in term 0.
I20260807 22:38:03.412449 31584 leader_election.cc:302] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62c8178399774156acea65f07b06a3da, 983c28e7f9864cfeb4ec156d0c144ec0; no voters:
I20260807 22:38:03.412738 31875 raft_consensus.cc:2781] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:38:03.412828 31875 raft_consensus.cc:482] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:03.412873 31875 raft_consensus.cc:3037] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:03.413992 31875 raft_consensus.cc:504] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 } } peers { permanent_uuid: "62c8178399774156acea65f07b06a3da" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 41817 } } peers { permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 } }
I20260807 22:38:03.414377 31875 leader_election.cc:288] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [CANDIDATE]: Term 1 election: Requested vote from peers 983c28e7f9864cfeb4ec156d0c144ec0 (127.26.52.67:40135), 4eb4dccce20d4a2a83e0e0addd534bfe (127.26.52.65:46293)
I20260807 22:38:03.414737 31797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2338c77544c0494bba48737768803578" candidate_uuid: "62c8178399774156acea65f07b06a3da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "983c28e7f9864cfeb4ec156d0c144ec0"
I20260807 22:38:03.414757 31509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2338c77544c0494bba48737768803578" candidate_uuid: "62c8178399774156acea65f07b06a3da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe"
I20260807 22:38:03.414872 31797 raft_consensus.cc:3037] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:03.414894 31509 raft_consensus.cc:3037] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:03.416181 31797 raft_consensus.cc:2454] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62c8178399774156acea65f07b06a3da in term 1.
I20260807 22:38:03.416194 31509 raft_consensus.cc:2454] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62c8178399774156acea65f07b06a3da in term 1.
I20260807 22:38:03.416497 31584 leader_election.cc:302] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62c8178399774156acea65f07b06a3da, 983c28e7f9864cfeb4ec156d0c144ec0; no voters:
I20260807 22:38:03.416708 31875 raft_consensus.cc:2781] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:03.416918 31875 raft_consensus.cc:686] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 1 LEADER]: Becoming Leader. State: Replica: 62c8178399774156acea65f07b06a3da, State: Running, Role: LEADER
I20260807 22:38:03.417248 31875 consensus_queue.cc:237] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 } } peers { permanent_uuid: "62c8178399774156acea65f07b06a3da" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 41817 } } peers { permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 } }
I20260807 22:38:03.420464 31349 catalog_manager.cc:5495] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da reported cstate change: term changed from 0 to 1, leader changed from <none> to 62c8178399774156acea65f07b06a3da (127.26.52.66). New cstate: current_term: 1 leader_uuid: "62c8178399774156acea65f07b06a3da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62c8178399774156acea65f07b06a3da" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 41817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 } health_report { overall_health: UNKNOWN } } }
W20260807 22:38:03.456453 31849 tablet.cc:2369] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:38:03.460734 31864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.457141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38248 (local address 127.26.52.66:41817)
0807 22:38:03.457303 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:03.457308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:03.457323 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:38:03.457442 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:03.457445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:03.457498 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:03.457613 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:03.457876 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.458367 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.459225 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:03.459446 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:03.459551 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:03.459873 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:03.460327 (+ 454us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:03.460451 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.460524 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.460580 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 22:38:03.466500 31509 raft_consensus.cc:1261] T 2338c77544c0494bba48737768803578 P 4eb4dccce20d4a2a83e0e0addd534bfe [term 1 FOLLOWER]: Refusing update from remote peer 62c8178399774156acea65f07b06a3da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:03.466501 31797 raft_consensus.cc:1261] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0 [term 1 FOLLOWER]: Refusing update from remote peer 62c8178399774156acea65f07b06a3da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:03.467213 31875 consensus_queue.cc:1035] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eb4dccce20d4a2a83e0e0addd534bfe" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 46293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:03.467435 31879 consensus_queue.cc:1035] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [LEADER]: Connected to new peer: Peer: permanent_uuid: "983c28e7f9864cfeb4ec156d0c144ec0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:03.475469 31884 mvcc.cc:205] Tried to move back new op lower bound from 7316038793071894528 to 7316038792879673344. Current Snapshot: MvccSnapshot[applied={T|T < 7316038793071894528}]
I20260807 22:38:03.483657 31347 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:03.483834 31347 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:03.486284 31347 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 47b74cb8f1054a018f2a6bddb1baa678: Sending DeleteTablet for 3 replicas of tablet 2338c77544c0494bba48737768803578
I20260807 22:38:03.487150 31631 tablet_service.cc:1514] Processing DeleteTablet for tablet 2338c77544c0494bba48737768803578 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:03 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:49666
I20260807 22:38:03.487183 31776 tablet_service.cc:1514] Processing DeleteTablet for tablet 2338c77544c0494bba48737768803578 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:03 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:50516
I20260807 22:38:03.487638 31487 tablet_service.cc:1514] Processing DeleteTablet for tablet 2338c77544c0494bba48737768803578 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:03 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:50054
I20260807 22:38:03.487694 31893 tablet_replica.cc:330] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: stopping tablet replica
I20260807 22:38:03.487849 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 31420
I20260807 22:38:03.488003 31893 raft_consensus.cc:2229] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:03.488312 31893 raft_consensus.cc:2258] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:03.491245 31893 ts_tablet_manager.cc:1905] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:03.493688 31893 ts_tablet_manager.cc:1918] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:03.493813 31893 log.cc:1196] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/2338c77544c0494bba48737768803578
I20260807 22:38:03.494128 31893 ts_tablet_manager.cc:1939] T 2338c77544c0494bba48737768803578 P 983c28e7f9864cfeb4ec156d0c144ec0: Deleting consensus metadata
I20260807 22:38:03.495150 31892 tablet_replica.cc:330] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da: stopping tablet replica
I20260807 22:38:03.495215 31332 catalog_manager.cc:4841] TS 983c28e7f9864cfeb4ec156d0c144ec0 (127.26.52.67:40135): tablet 2338c77544c0494bba48737768803578 (table test-table [id=517f330c969145db824f03b3c94108d1]) successfully deleted
I20260807 22:38:03.495504 31892 raft_consensus.cc:2229] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:38:03.495857 31892 raft_consensus.cc:2258] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:03.497206 31892 ts_tablet_manager.cc:1905] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 22:38:03.498528 31330 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:46293 (error 108)
I20260807 22:38:03.499310 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 31565
I20260807 22:38:03.499787 31892 ts_tablet_manager.cc:1918] T 2338c77544c0494bba48737768803578 P 62c8178399774156acea65f07b06a3da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:03.501307 31860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.500663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:46293 (local address 127.0.0.1:45568)
0807 22:38:03.501105 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:03.501203 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:46293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330}
W20260807 22:38:03.501458 31330 catalog_manager.cc:4584] TS 4eb4dccce20d4a2a83e0e0addd534bfe (127.26.52.65:46293): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2338c77544c0494bba48737768803578: Network error: Client connection negotiation failed: client connection to 127.26.52.65:46293: connect: Connection refused (error 111)
I20260807 22:38:03.508381 31860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.508044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:41817 (local address 127.0.0.1:38254)
0807 22:38:03.508250 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:03.508307 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.66:41817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 22:38:03.508505 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 31709
I20260807 22:38:03.516454 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 31311
2026-08-07T22:38:03Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2433 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T22:38:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:03Z Disabled control of system clock
I20260807 22:38:03.549014 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:38651
--webserver_interface=127.26.52.126
--webserver_port=0
--builtin_ntp_servers=127.26.52.84:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:38651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 22:38:03.659150 31900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:03.659399 31900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:03.659442 31900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:03.663290 31900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:03.663340 31900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:03.663355 31900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:03.663371 31900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:03.663386 31900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:03.667906 31900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:38651
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:38651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:03.668992 31900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:03.670290 31900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:03.678681 31905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:03.678670 31908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:03.678779 31900 server_base.cc:1034] running on GCE node
W20260807 22:38:03.678671 31906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:03.679448 31900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:03.680577 31900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:03.681744 31900 hybrid_clock.cc:648] HybridClock initialized: now 1786142283681714 us; error 40 us; skew 500 ppm
I20260807 22:38:03.683472 31900 webserver.cc:460] Webserver started at http://127.26.52.126:42321/ using document root <none> and password file <none>
I20260807 22:38:03.684036 31900 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:03.684095 31900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:03.684361 31900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:03.686352 31900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "e58b669b7c3540de82e8a7f17a519b93"
format_stamp: "Formatted at 2026-08-07 22:38:03 on dist-test-slave-8w9v"
server_key: "a947658b5764a12c8eade3ebcdd00b47"
server_key_iv: "72b3958c19068bed6ce44671e00cbe30"
server_key_version: "encryptionkey@0"
I20260807 22:38:03.686905 31900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "e58b669b7c3540de82e8a7f17a519b93"
format_stamp: "Formatted at 2026-08-07 22:38:03 on dist-test-slave-8w9v"
server_key: "a947658b5764a12c8eade3ebcdd00b47"
server_key_iv: "72b3958c19068bed6ce44671e00cbe30"
server_key_version: "encryptionkey@0"
I20260807 22:38:03.690435 31900 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 22:38:03.692718 31914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:03.693888 31900 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:38:03.694036 31900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "e58b669b7c3540de82e8a7f17a519b93"
format_stamp: "Formatted at 2026-08-07 22:38:03 on dist-test-slave-8w9v"
server_key: "a947658b5764a12c8eade3ebcdd00b47"
server_key_iv: "72b3958c19068bed6ce44671e00cbe30"
server_key_version: "encryptionkey@0"
I20260807 22:38:03.694155 31900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:03.698627 31900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:03.699220 31900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:03.699409 31900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:03.706458 31900 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:38651
I20260807 22:38:03.706512 31968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:38651 every 8 connection(s)
I20260807 22:38:03.707392 31900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:03.710630 31970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:03.714594 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 31900
I20260807 22:38:03.714738 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:03.715001 26833 external_mini_cluster.cc:1428] Setting key 836d4fa17d4e8b06a487c9c1e7fa216d
I20260807 22:38:03.716270 31970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93: Bootstrap starting.
I20260807 22:38:03.718453 31970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:03.719277 31970 log.cc:824] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:03.720522 31974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.716426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57842 (local address 127.26.52.126:38651)
0807 22:38:03.717038 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:03.717053 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:03.717085 (+ 32us) server_negotiation.cc:407] Connection header received
0807 22:38:03.717669 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:03.717684 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:03.717998 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:03.718307 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:03.719112 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:03.719117 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:03.719132 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:03.719147 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:03.719196 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:03.719210 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:03.719324 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.719437 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.719697 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":120,"threads_started":1}
I20260807 22:38:03.721298 31970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93: No bootstrap required, opened a new log
I20260807 22:38:03.724874 31970 raft_consensus.cc:348] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e58b669b7c3540de82e8a7f17a519b93" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38651 } }
I20260807 22:38:03.725093 31970 raft_consensus.cc:374] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:03.725171 31970 raft_consensus.cc:729] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e58b669b7c3540de82e8a7f17a519b93, State: Initialized, Role: FOLLOWER
I20260807 22:38:03.725561 31970 consensus_queue.cc:260] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e58b669b7c3540de82e8a7f17a519b93" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38651 } }
I20260807 22:38:03.725705 31970 raft_consensus.cc:388] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:03.725790 31970 raft_consensus.cc:482] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:03.725909 31970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:03.726877 31970 raft_consensus.cc:504] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e58b669b7c3540de82e8a7f17a519b93" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38651 } }
I20260807 22:38:03.727216 31970 leader_election.cc:302] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e58b669b7c3540de82e8a7f17a519b93; no voters:
I20260807 22:38:03.727502 31970 leader_election.cc:288] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:03.727607 31976 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:03.727837 31976 raft_consensus.cc:686] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [term 1 LEADER]: Becoming Leader. State: Replica: e58b669b7c3540de82e8a7f17a519b93, State: Running, Role: LEADER
I20260807 22:38:03.728179 31976 consensus_queue.cc:237] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e58b669b7c3540de82e8a7f17a519b93" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38651 } }
I20260807 22:38:03.728773 31970 sys_catalog.cc:564] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:03.729836 31979 sys_catalog.cc:455] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e58b669b7c3540de82e8a7f17a519b93. Latest consensus state: current_term: 1 leader_uuid: "e58b669b7c3540de82e8a7f17a519b93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e58b669b7c3540de82e8a7f17a519b93" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38651 } } }
I20260807 22:38:03.729966 31979 sys_catalog.cc:458] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:03.730226 31978 sys_catalog.cc:455] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e58b669b7c3540de82e8a7f17a519b93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e58b669b7c3540de82e8a7f17a519b93" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38651 } } }
I20260807 22:38:03.730798 31986 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:03.730804 31978 sys_catalog.cc:458] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:03.733587 31986 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:03.738619 31986 catalog_manager.cc:1347] Generated new cluster ID: 0cb062e5f81e4e9bbf90ae79e757b065
I20260807 22:38:03.738688 31986 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:03.754841 31986 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:03.755167 31986 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:03.769742 31986 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93: Generated new TSK 0
I20260807 22:38:03.770556 31986 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:38:03.777899 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38651
--builtin_ntp_servers=127.26.52.84:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 22:38:03.890064 31997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:03.890334 31997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:03.890393 31997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:03.894433 31997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:03.894488 31997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:03.894591 31997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:03.899654 31997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:03.900769 31997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:03.902158 31997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:03.911892 32003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:03.911902 32004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:03.911929 32006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:03.912177 31997 server_base.cc:1034] running on GCE node
I20260807 22:38:03.912683 31997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:03.913296 31997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:03.914460 31997 hybrid_clock.cc:648] HybridClock initialized: now 1786142283914446 us; error 24 us; skew 500 ppm
I20260807 22:38:03.916334 31997 webserver.cc:460] Webserver started at http://127.26.52.65:38157/ using document root <none> and password file <none>
I20260807 22:38:03.916905 31997 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:03.916970 31997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:03.917230 31997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:03.919262 31997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "0a72fe968dc843d988f7ea2b6937bb68"
format_stamp: "Formatted at 2026-08-07 22:38:03 on dist-test-slave-8w9v"
server_key: "9cb1c9a8fb99652a8bb52d8530d21637"
server_key_iv: "9bec298fdbcb3e4e5640502c835014e7"
server_key_version: "encryptionkey@0"
I20260807 22:38:03.919816 31997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "0a72fe968dc843d988f7ea2b6937bb68"
format_stamp: "Formatted at 2026-08-07 22:38:03 on dist-test-slave-8w9v"
server_key: "9cb1c9a8fb99652a8bb52d8530d21637"
server_key_iv: "9bec298fdbcb3e4e5640502c835014e7"
server_key_version: "encryptionkey@0"
I20260807 22:38:03.923380 31997 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:38:03.925834 32013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:03.926991 31997 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:03.927122 31997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "0a72fe968dc843d988f7ea2b6937bb68"
format_stamp: "Formatted at 2026-08-07 22:38:03 on dist-test-slave-8w9v"
server_key: "9cb1c9a8fb99652a8bb52d8530d21637"
server_key_iv: "9bec298fdbcb3e4e5640502c835014e7"
server_key_version: "encryptionkey@0"
I20260807 22:38:03.927234 31997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:03.931751 31997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:03.932384 31997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:03.932560 31997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:03.933059 31997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:03.933893 31997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:03.933960 31997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:03.934041 31997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:03.934085 31997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:03.942178 31997 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:38539
I20260807 22:38:03.942239 32134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:38539 every 8 connection(s)
I20260807 22:38:03.943014 31997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:03.944823 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 31997
I20260807 22:38:03.944960 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:38:03.945243 26833 external_mini_cluster.cc:1428] Setting key b69be382d1b34f00a19f07af1af83c1d
I20260807 22:38:03.947427 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38651
--builtin_ntp_servers=127.26.52.84:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 22:38:03.949651 31974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.944772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:59437 (local address 127.26.52.126:38651)
0807 22:38:03.944940 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:03.944946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:03.946047 (+ 1101us) server_negotiation.cc:407] Connection header received
0807 22:38:03.947648 (+ 1601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:03.947654 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:03.947702 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:03.947757 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:03.949124 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:03.949130 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:03.949134 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:03.949152 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:03.949180 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:03.949193 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:03.949302 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:03.949432 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 22:38:03.949480 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:38:03.950349 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:03.945156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:38651 (local address 127.26.52.65:59437)
0807 22:38:03.945884 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:03.945936 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:03.947393 (+ 1457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:03.948114 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:03.948145 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:03.948256 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:03.948807 (+ 551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:03.948811 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:03.948863 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:03.948949 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:03.949295 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:03.949303 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:03.949307 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:38:03.949443 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 22:38:03.949618 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":147,"threads_started":1}
I20260807 22:38:03.951589 32135 heartbeater.cc:347] Connected to a master server at 127.26.52.126:38651
I20260807 22:38:03.951823 32135 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:03.952289 32135 heartbeater.cc:511] Master 127.26.52.126:38651 requested a full tablet report, sending...
I20260807 22:38:03.953727 31931 ts_manager.cc:194] Registered new tserver with Master: 0a72fe968dc843d988f7ea2b6937bb68 (127.26.52.65:38539)
W20260807 22:38:04.059458 32138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:04.059764 32138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:04.059846 32138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:04.063786 32138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:04.063863 32138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:04.063978 32138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:04.068570 32138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:04.069613 32138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:04.070996 32138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:04.080513 32146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:04.080506 32144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:04.080506 32143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:04.080786 32138 server_base.cc:1034] running on GCE node
I20260807 22:38:04.081173 32138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:04.081782 32138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:04.082967 32138 hybrid_clock.cc:648] HybridClock initialized: now 1786142284082954 us; error 25 us; skew 500 ppm
I20260807 22:38:04.084774 32138 webserver.cc:460] Webserver started at http://127.26.52.66:43991/ using document root <none> and password file <none>
I20260807 22:38:04.085400 32138 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:04.085502 32138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:04.085741 32138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:04.087755 32138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "94a4b14aaf6e49adad5e0f2b5a31febc"
format_stamp: "Formatted at 2026-08-07 22:38:04 on dist-test-slave-8w9v"
server_key: "92557c8c78c9f74af8b18595c6d92fc9"
server_key_iv: "715dd5ecc19a0c387d457af1365e38c5"
server_key_version: "encryptionkey@0"
I20260807 22:38:04.088382 32138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "94a4b14aaf6e49adad5e0f2b5a31febc"
format_stamp: "Formatted at 2026-08-07 22:38:04 on dist-test-slave-8w9v"
server_key: "92557c8c78c9f74af8b18595c6d92fc9"
server_key_iv: "715dd5ecc19a0c387d457af1365e38c5"
server_key_version: "encryptionkey@0"
I20260807 22:38:04.091897 32138 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 22:38:04.094285 32153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:04.095364 32138 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:04.095501 32138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "94a4b14aaf6e49adad5e0f2b5a31febc"
format_stamp: "Formatted at 2026-08-07 22:38:04 on dist-test-slave-8w9v"
server_key: "92557c8c78c9f74af8b18595c6d92fc9"
server_key_iv: "715dd5ecc19a0c387d457af1365e38c5"
server_key_version: "encryptionkey@0"
I20260807 22:38:04.095610 32138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:04.100033 32138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:04.100666 32138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:04.100847 32138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:04.101379 32138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:04.102262 32138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:04.102332 32138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:04.102401 32138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:04.102461 32138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:04.111321 32138 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:39585
I20260807 22:38:04.111339 32272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:39585 every 8 connection(s)
I20260807 22:38:04.112293 32138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:04.115119 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 32138
I20260807 22:38:04.115252 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:38:04.115612 26833 external_mini_cluster.cc:1428] Setting key b87f56a652e3dd60d29bafbfecf305e3
I20260807 22:38:04.118170 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38651
--builtin_ntp_servers=127.26.52.84:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 22:38:04.119094 31974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.114095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:46613 (local address 127.26.52.126:38651)
0807 22:38:04.114241 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.114245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.115387 (+ 1142us) server_negotiation.cc:407] Connection header received
0807 22:38:04.117136 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.117139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.117181 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.117273 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:04.118619 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:04.118622 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:04.118624 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:04.118636 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:04.118656 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:04.118663 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:04.118753 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:04.118951 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 22:38:04.118988 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:38:04.120260 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.114483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:38651 (local address 127.26.52.66:46613)
0807 22:38:04.115225 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:04.115282 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:04.116872 (+ 1590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:04.117580 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:04.117588 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:04.117695 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:04.118318 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:04.118323 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:04.118380 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:04.118468 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:04.118770 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:04.118782 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:04.118792 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 22:38:04.118987 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 22:38:04.119225 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":115,"threads_started":1}
I20260807 22:38:04.121304 32273 heartbeater.cc:347] Connected to a master server at 127.26.52.126:38651
I20260807 22:38:04.121547 32273 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:04.122000 32273 heartbeater.cc:511] Master 127.26.52.126:38651 requested a full tablet report, sending...
I20260807 22:38:04.123149 31931 ts_manager.cc:194] Registered new tserver with Master: 94a4b14aaf6e49adad5e0f2b5a31febc (127.26.52.66:39585)
W20260807 22:38:04.227398 32276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:04.227622 32276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:04.227684 32276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:04.231858 32276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:04.231905 32276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:04.232002 32276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:04.236511 32276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:04.237531 32276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:04.238899 32276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:04.248461 32283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:04.248467 32281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:04.248481 32285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:04.248667 32276 server_base.cc:1034] running on GCE node
I20260807 22:38:04.249177 32276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:04.249759 32276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:04.250921 32276 hybrid_clock.cc:648] HybridClock initialized: now 1786142284250903 us; error 34 us; skew 500 ppm
I20260807 22:38:04.252699 32276 webserver.cc:460] Webserver started at http://127.26.52.67:45145/ using document root <none> and password file <none>
I20260807 22:38:04.253266 32276 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:04.253325 32276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:04.253575 32276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:04.255581 32276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "70571364368a436394f905f79ec969a6"
format_stamp: "Formatted at 2026-08-07 22:38:04 on dist-test-slave-8w9v"
server_key: "fa9b63cfeecf5a76b5490c7d21f9eb5a"
server_key_iv: "d72aa7fc084b7c0aa366e0c5119750cc"
server_key_version: "encryptionkey@0"
I20260807 22:38:04.256198 32276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "70571364368a436394f905f79ec969a6"
format_stamp: "Formatted at 2026-08-07 22:38:04 on dist-test-slave-8w9v"
server_key: "fa9b63cfeecf5a76b5490c7d21f9eb5a"
server_key_iv: "d72aa7fc084b7c0aa366e0c5119750cc"
server_key_version: "encryptionkey@0"
I20260807 22:38:04.259737 32276 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:38:04.262264 32292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:04.263438 32276 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:04.263554 32276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "70571364368a436394f905f79ec969a6"
format_stamp: "Formatted at 2026-08-07 22:38:04 on dist-test-slave-8w9v"
server_key: "fa9b63cfeecf5a76b5490c7d21f9eb5a"
server_key_iv: "d72aa7fc084b7c0aa366e0c5119750cc"
server_key_version: "encryptionkey@0"
I20260807 22:38:04.263655 32276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:04.268093 32276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:04.268746 32276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:04.268945 32276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:04.269513 32276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:04.270380 32276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:04.270430 32276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:04.270493 32276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:04.270529 32276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:04.278769 32276 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:33103
I20260807 22:38:04.278790 32415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:33103 every 8 connection(s)
I20260807 22:38:04.279603 32276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:38:04.285431 31974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.281332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:44831 (local address 127.26.52.126:38651)
0807 22:38:04.281479 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.281483 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.282448 (+ 965us) server_negotiation.cc:407] Connection header received
0807 22:38:04.283780 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.283783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.283827 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.283930 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:04.284964 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:04.284967 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:04.284970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:04.284981 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:04.285001 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:04.285010 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:04.285109 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:04.285245 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 22:38:04.285291 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:38:04.285956 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 32276
I20260807 22:38:04.286082 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:38:04.286374 26833 external_mini_cluster.cc:1428] Setting key d0b149e5c4e5705c9f6326570bd3c170
I20260807 22:38:04.286455 32418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.281698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:38651 (local address 127.26.52.67:44831)
0807 22:38:04.282304 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:04.282340 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:04.283561 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:04.284091 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:04.284098 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:04.284238 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:04.284726 (+ 488us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:04.284728 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:04.284764 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:04.284824 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:04.285094 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:04.285102 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:04.285107 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:38:04.285273 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 22:38:04.285487 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":107,"threads_started":1}
I20260807 22:38:04.287542 32416 heartbeater.cc:347] Connected to a master server at 127.26.52.126:38651
I20260807 22:38:04.287750 32416 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:04.288177 32416 heartbeater.cc:511] Master 127.26.52.126:38651 requested a full tablet report, sending...
I20260807 22:38:04.289111 31930 ts_manager.cc:194] Registered new tserver with Master: 70571364368a436394f905f79ec969a6 (127.26.52.67:33103)
I20260807 22:38:04.299885 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:38:04.303165 31974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.301817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57846 (local address 127.26.52.126:38651)
0807 22:38:04.301953 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.301957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.302072 (+ 115us) server_negotiation.cc:407] Connection header received
0807 22:38:04.302162 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.302164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.302193 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.302268 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:04.302829 (+ 561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:04.302832 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:04.302834 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:04.302844 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:04.302861 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:04.302868 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:04.302938 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:04.302982 (+ 44us) server_negotiation.cc:299] Negotiation successful
0807 22:38:04.303011 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:38:04.305784 31930 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57846:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:38:04.308851 31930 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:38:04.320173 32428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.316882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:33103 (local address 127.0.0.1:60450)
0807 22:38:04.317234 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:04.317275 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:04.317381 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:04.318146 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:04.318152 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:04.318228 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:04.318789 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:04.318791 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:04.318813 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:04.318885 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:04.319768 (+ 883us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:04.319777 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:04.319783 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:38:04.319917 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 22:38:04.320000 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":105,"threads_started":1}
I20260807 22:38:04.320256 32430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.317008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60450 (local address 127.26.52.67:33103)
0807 22:38:04.317657 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.317673 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.317697 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:38:04.317750 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.317756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.317964 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.318525 (+ 561us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:04.319533 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:04.319540 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:04.319554 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:04.319566 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:04.319610 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:04.319648 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:04.319802 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:04.319953 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 22:38:04.320035 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":142,"threads_started":1}
I20260807 22:38:04.320690 32429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.318135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38539 (local address 127.0.0.1:47180)
0807 22:38:04.318485 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:04.318500 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:04.318574 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:04.319169 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:04.319175 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:04.319195 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:04.319674 (+ 479us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:04.319678 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:04.319693 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:04.319725 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:04.320447 (+ 722us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:04.320450 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:04.320453 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:38:04.320524 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 22:38:04.320565 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":89,"threads_started":1}
I20260807 22:38:04.321048 32433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.318308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47180 (local address 127.26.52.65:38539)
0807 22:38:04.318750 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.318761 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.318786 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:38:04.318828 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.318856 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.319017 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.319159 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:04.319896 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:04.319904 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:04.319915 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:04.320194 (+ 279us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:04.320247 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:04.320287 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:04.320392 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:04.320843 (+ 451us) server_negotiation.cc:299] Negotiation successful
0807 22:38:04.320909 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":126,"threads_started":1}
I20260807 22:38:04.321488 32432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.316969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:39585 (local address 127.0.0.1:35996)
0807 22:38:04.318369 (+ 1400us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:04.318383 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:04.318779 (+ 396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:04.319768 (+ 989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:04.319771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:04.319785 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:04.320774 (+ 989us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:04.320778 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:04.320791 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:04.320825 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:04.321248 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:04.321253 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:04.321256 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:38:04.321341 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 22:38:04.321375 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1331,"thread_start_us":116,"threads_started":1}
I20260807 22:38:04.321979 32431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.317670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35996 (local address 127.26.52.66:39585)
0807 22:38:04.318120 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.318132 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.318693 (+ 561us) server_negotiation.cc:407] Connection header received
0807 22:38:04.318920 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.318925 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.319061 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.319176 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:04.320986 (+ 1810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:04.320993 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:04.321004 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:04.321016 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:04.321056 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:04.321086 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:04.321200 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:04.321757 (+ 557us) server_negotiation.cc:299] Negotiation successful
0807 22:38:04.321824 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":143,"threads_started":1}
I20260807 22:38:04.323478 32344 tablet_service.cc:1467] Processing CreateTablet for tablet 2485635dfe274ec89f871ada942c6a5b (DEFAULT_TABLE table=test-table [id=80506b44c841459b8e4bbf223af301bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:04.323587 32063 tablet_service.cc:1467] Processing CreateTablet for tablet 2485635dfe274ec89f871ada942c6a5b (DEFAULT_TABLE table=test-table [id=80506b44c841459b8e4bbf223af301bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:04.324309 32204 tablet_service.cc:1467] Processing CreateTablet for tablet 2485635dfe274ec89f871ada942c6a5b (DEFAULT_TABLE table=test-table [id=80506b44c841459b8e4bbf223af301bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:04.324647 32344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2485635dfe274ec89f871ada942c6a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:04.324647 32063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2485635dfe274ec89f871ada942c6a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:04.325129 32204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2485635dfe274ec89f871ada942c6a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:04.331611 32434 tablet_bootstrap.cc:492] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: Bootstrap starting.
I20260807 22:38:04.332496 32436 tablet_bootstrap.cc:492] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: Bootstrap starting.
I20260807 22:38:04.334183 32434 tablet_bootstrap.cc:654] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:04.334185 32436 tablet_bootstrap.cc:654] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:04.334887 32436 log.cc:824] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:04.334887 32434 log.cc:824] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:04.335584 32435 tablet_bootstrap.cc:492] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68: Bootstrap starting.
I20260807 22:38:04.336941 32434 tablet_bootstrap.cc:492] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: No bootstrap required, opened a new log
I20260807 22:38:04.336941 32436 tablet_bootstrap.cc:492] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: No bootstrap required, opened a new log
I20260807 22:38:04.337128 32436 ts_tablet_manager.cc:1397] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:38:04.337128 32434 ts_tablet_manager.cc:1397] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:38:04.337450 32435 tablet_bootstrap.cc:654] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:04.338243 32435 log.cc:824] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:04.339900 32435 tablet_bootstrap.cc:492] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68: No bootstrap required, opened a new log
I20260807 22:38:04.340162 32435 ts_tablet_manager.cc:1397] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:38:04.341670 32434 raft_consensus.cc:348] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 } } peers { permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 } } peers { permanent_uuid: "0a72fe968dc843d988f7ea2b6937bb68" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38539 } }
I20260807 22:38:04.341670 32436 raft_consensus.cc:348] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 } } peers { permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 } } peers { permanent_uuid: "0a72fe968dc843d988f7ea2b6937bb68" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38539 } }
I20260807 22:38:04.341920 32434 raft_consensus.cc:374] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:04.341931 32436 raft_consensus.cc:374] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:04.341975 32436 raft_consensus.cc:729] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70571364368a436394f905f79ec969a6, State: Initialized, Role: FOLLOWER
I20260807 22:38:04.341975 32434 raft_consensus.cc:729] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a4b14aaf6e49adad5e0f2b5a31febc, State: Initialized, Role: FOLLOWER
I20260807 22:38:04.342458 32434 consensus_queue.cc:260] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 } } peers { permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 } } peers { permanent_uuid: "0a72fe968dc843d988f7ea2b6937bb68" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38539 } }
I20260807 22:38:04.342451 32436 consensus_queue.cc:260] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 } } peers { permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 } } peers { permanent_uuid: "0a72fe968dc843d988f7ea2b6937bb68" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38539 } }
I20260807 22:38:04.343319 32416 heartbeater.cc:503] Master 127.26.52.126:38651 was elected leader, sending a full tablet report...
I20260807 22:38:04.343438 32434 ts_tablet_manager.cc:1428] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:38:04.343429 32436 ts_tablet_manager.cc:1428] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:38:04.343822 32273 heartbeater.cc:503] Master 127.26.52.126:38651 was elected leader, sending a full tablet report...
I20260807 22:38:04.343742 32435 raft_consensus.cc:348] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 } } peers { permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 } } peers { permanent_uuid: "0a72fe968dc843d988f7ea2b6937bb68" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38539 } }
I20260807 22:38:04.343984 32435 raft_consensus.cc:374] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:04.344053 32435 raft_consensus.cc:729] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a72fe968dc843d988f7ea2b6937bb68, State: Initialized, Role: FOLLOWER
I20260807 22:38:04.344489 32435 consensus_queue.cc:260] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 } } peers { permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 } } peers { permanent_uuid: "0a72fe968dc843d988f7ea2b6937bb68" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38539 } }
I20260807 22:38:04.345498 32435 ts_tablet_manager.cc:1428] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:38:04.345860 32135 heartbeater.cc:503] Master 127.26.52.126:38651 was elected leader, sending a full tablet report...
W20260807 22:38:04.363205 32274 tablet.cc:2369] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:38:04.444196 32136 tablet.cc:2369] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:38:04.460984 32442 raft_consensus.cc:482] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:04.461195 32442 raft_consensus.cc:504] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 } } peers { permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 } } peers { permanent_uuid: "0a72fe968dc843d988f7ea2b6937bb68" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38539 } }
I20260807 22:38:04.462713 32442 leader_election.cc:288] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70571364368a436394f905f79ec969a6 (127.26.52.67:33103), 94a4b14aaf6e49adad5e0f2b5a31febc (127.26.52.66:39585)
I20260807 22:38:04.464851 32443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.462966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:39585 (local address 127.26.52.65:33567)
0807 22:38:04.463249 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:04.463263 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:04.463394 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:04.463631 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:04.463634 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:04.463648 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:04.464214 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:04.464216 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:04.464226 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:04.464252 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:04.464560 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:04.464564 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:04.464567 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:38:04.464653 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:38:04.464691 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":89,"threads_started":1}
I20260807 22:38:04.464854 32431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.463108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:33567 (local address 127.26.52.66:39585)
0807 22:38:04.463243 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.463248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.463361 (+ 113us) server_negotiation.cc:407] Connection header received
0807 22:38:04.463481 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.463485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.463527 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.463613 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:04.464403 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:04.464407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:04.464409 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:04.464431 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:04.464459 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:04.464468 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:04.464577 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:04.464663 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 22:38:04.464712 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 22:38:04.465075 32430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.463049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:58255 (local address 127.26.52.67:33103)
0807 22:38:04.463230 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.463235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.463585 (+ 350us) server_negotiation.cc:407] Connection header received
0807 22:38:04.463727 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.463730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.463771 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.463863 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:04.464602 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:04.464608 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:04.464611 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:04.464625 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:04.464648 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:04.464658 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:04.464718 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:04.464879 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 22:38:04.464934 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 22:38:04.465543 32444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.462973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:33103 (local address 127.26.52.65:58255)
0807 22:38:04.463486 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:04.463507 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:04.463617 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:04.463908 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:04.463910 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:04.463928 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:04.464431 (+ 503us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:04.464434 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:04.464443 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:04.464465 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:04.464785 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:04.464788 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:04.464791 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:38:04.465363 (+ 572us) client_negotiation.cc:240] Negotiation successful
0807 22:38:04.465400 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":284,"thread_start_us":72,"threads_started":1}
I20260807 22:38:04.465853 32224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2485635dfe274ec89f871ada942c6a5b" candidate_uuid: "0a72fe968dc843d988f7ea2b6937bb68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" is_pre_election: true
I20260807 22:38:04.466171 32224 raft_consensus.cc:2454] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a72fe968dc843d988f7ea2b6937bb68 in term 0.
I20260807 22:38:04.466216 32366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2485635dfe274ec89f871ada942c6a5b" candidate_uuid: "0a72fe968dc843d988f7ea2b6937bb68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70571364368a436394f905f79ec969a6" is_pre_election: true
I20260807 22:38:04.466491 32366 raft_consensus.cc:2454] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a72fe968dc843d988f7ea2b6937bb68 in term 0.
I20260807 22:38:04.466617 32016 leader_election.cc:302] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a72fe968dc843d988f7ea2b6937bb68, 94a4b14aaf6e49adad5e0f2b5a31febc; no voters:
I20260807 22:38:04.466907 32442 raft_consensus.cc:2781] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:38:04.467000 32442 raft_consensus.cc:482] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:04.467056 32442 raft_consensus.cc:3037] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:04.468243 32442 raft_consensus.cc:504] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 } } peers { permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 } } peers { permanent_uuid: "0a72fe968dc843d988f7ea2b6937bb68" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38539 } }
I20260807 22:38:04.468600 32442 leader_election.cc:288] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [CANDIDATE]: Term 1 election: Requested vote from peers 70571364368a436394f905f79ec969a6 (127.26.52.67:33103), 94a4b14aaf6e49adad5e0f2b5a31febc (127.26.52.66:39585)
I20260807 22:38:04.468905 32224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2485635dfe274ec89f871ada942c6a5b" candidate_uuid: "0a72fe968dc843d988f7ea2b6937bb68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc"
I20260807 22:38:04.468904 32366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2485635dfe274ec89f871ada942c6a5b" candidate_uuid: "0a72fe968dc843d988f7ea2b6937bb68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70571364368a436394f905f79ec969a6"
I20260807 22:38:04.469031 32224 raft_consensus.cc:3037] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:04.469054 32366 raft_consensus.cc:3037] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:04.470304 32224 raft_consensus.cc:2454] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a72fe968dc843d988f7ea2b6937bb68 in term 1.
I20260807 22:38:04.470304 32366 raft_consensus.cc:2454] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a72fe968dc843d988f7ea2b6937bb68 in term 1.
I20260807 22:38:04.470579 32016 leader_election.cc:302] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a72fe968dc843d988f7ea2b6937bb68, 94a4b14aaf6e49adad5e0f2b5a31febc; no voters:
I20260807 22:38:04.470767 32442 raft_consensus.cc:2781] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:04.470975 32442 raft_consensus.cc:686] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [term 1 LEADER]: Becoming Leader. State: Replica: 0a72fe968dc843d988f7ea2b6937bb68, State: Running, Role: LEADER
I20260807 22:38:04.471285 32442 consensus_queue.cc:237] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 } } peers { permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 } } peers { permanent_uuid: "0a72fe968dc843d988f7ea2b6937bb68" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38539 } }
I20260807 22:38:04.474515 31929 catalog_manager.cc:5495] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a72fe968dc843d988f7ea2b6937bb68 (127.26.52.65). New cstate: current_term: 1 leader_uuid: "0a72fe968dc843d988f7ea2b6937bb68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a72fe968dc843d988f7ea2b6937bb68" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38539 } health_report { overall_health: HEALTHY } } }
I20260807 22:38:04.508167 32433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.506469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47192 (local address 127.26.52.65:38539)
0807 22:38:04.506622 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.506627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.506641 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:38:04.506804 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.506806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.506868 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.506970 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:04.507713 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:04.507717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:04.507720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:04.507732 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:04.507754 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:04.507766 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:04.507851 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:04.507944 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 22:38:04.507984 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:38:04.513868 32224 raft_consensus.cc:1261] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc [term 1 FOLLOWER]: Refusing update from remote peer 0a72fe968dc843d988f7ea2b6937bb68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:04.513868 32366 raft_consensus.cc:1261] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6 [term 1 FOLLOWER]: Refusing update from remote peer 0a72fe968dc843d988f7ea2b6937bb68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:04.514542 32442 consensus_queue.cc:1035] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a4b14aaf6e49adad5e0f2b5a31febc" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:04.514729 32445 consensus_queue.cc:1035] T 2485635dfe274ec89f871ada942c6a5b P 0a72fe968dc843d988f7ea2b6937bb68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70571364368a436394f905f79ec969a6" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:04.521656 32450 mvcc.cc:205] Tried to move back new op lower bound from 7316038797361831936 to 7316038797197008896. Current Snapshot: MvccSnapshot[applied={T|T < 7316038797361831936}]
I20260807 22:38:04.522162 32451 mvcc.cc:205] Tried to move back new op lower bound from 7316038797361831936 to 7316038797197008896. Current Snapshot: MvccSnapshot[applied={T|T < 7316038797361831936}]
I20260807 22:38:04.524708 32452 mvcc.cc:205] Tried to move back new op lower bound from 7316038797361831936 to 7316038797197008896. Current Snapshot: MvccSnapshot[applied={T|T < 7316038797361831936}]
I20260807 22:38:04.530244 31929 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:04.530431 31929 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:04.532933 31929 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e58b669b7c3540de82e8a7f17a519b93: Sending DeleteTablet for 3 replicas of tablet 2485635dfe274ec89f871ada942c6a5b
I20260807 22:38:04.533641 32344 tablet_service.cc:1514] Processing DeleteTablet for tablet 2485635dfe274ec89f871ada942c6a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:04 UTC) from {username='slave'} at 127.0.0.1:60450
I20260807 22:38:04.533641 32204 tablet_service.cc:1514] Processing DeleteTablet for tablet 2485635dfe274ec89f871ada942c6a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:04 UTC) from {username='slave'} at 127.0.0.1:35996
I20260807 22:38:04.534118 32460 tablet_replica.cc:330] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: stopping tablet replica
I20260807 22:38:04.534252 32063 tablet_service.cc:1514] Processing DeleteTablet for tablet 2485635dfe274ec89f871ada942c6a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:04 UTC) from {username='slave'} at 127.0.0.1:47180
I20260807 22:38:04.534438 32461 tablet_replica.cc:330] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: stopping tablet replica
I20260807 22:38:04.534601 32460 raft_consensus.cc:2229] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:04.534706 32461 raft_consensus.cc:2229] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:04.534970 32460 raft_consensus.cc:2258] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:04.534974 32461 raft_consensus.cc:2258] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:04.535060 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 31997
I20260807 22:38:04.537036 32460 ts_tablet_manager.cc:1905] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:04.537367 32461 ts_tablet_manager.cc:1905] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:04.539520 32461 ts_tablet_manager.cc:1918] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:04.539628 32461 log.cc:1196] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/2485635dfe274ec89f871ada942c6a5b
I20260807 22:38:04.539911 32461 ts_tablet_manager.cc:1939] T 2485635dfe274ec89f871ada942c6a5b P 70571364368a436394f905f79ec969a6: Deleting consensus metadata
I20260807 22:38:04.540504 32460 ts_tablet_manager.cc:1918] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:04.540602 32460 log.cc:1196] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/2485635dfe274ec89f871ada942c6a5b
I20260807 22:38:04.540895 32460 ts_tablet_manager.cc:1939] T 2485635dfe274ec89f871ada942c6a5b P 94a4b14aaf6e49adad5e0f2b5a31febc: Deleting consensus metadata
I20260807 22:38:04.541996 31917 catalog_manager.cc:4841] TS 94a4b14aaf6e49adad5e0f2b5a31febc (127.26.52.66:39585): tablet 2485635dfe274ec89f871ada942c6a5b (table test-table [id=80506b44c841459b8e4bbf223af301bd]) successfully deleted
I20260807 22:38:04.541997 31915 catalog_manager.cc:4841] TS 70571364368a436394f905f79ec969a6 (127.26.52.67:33103): tablet 2485635dfe274ec89f871ada942c6a5b (table test-table [id=80506b44c841459b8e4bbf223af301bd]) successfully deleted
W20260807 22:38:04.545584 31915 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:38539 (error 108)
I20260807 22:38:04.545779 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 32138
I20260807 22:38:04.548090 32432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.547814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38539 (local address 127.0.0.1:47206)
0807 22:38:04.547939 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:04.548012 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:38539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 22:38:04.548316 31915 catalog_manager.cc:4584] TS 0a72fe968dc843d988f7ea2b6937bb68 (127.26.52.65:38539): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2485635dfe274ec89f871ada942c6a5b: Network error: Client connection negotiation failed: client connection to 127.26.52.65:38539: connect: Connection refused (error 111)
I20260807 22:38:04.553068 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 32276
I20260807 22:38:04.560213 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 31900
2026-08-07T22:38:04Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1043 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 22:38:04.583734 26833 mini_oidc.cc:152] Starting JWKS server
I20260807 22:38:04.585615 26833 webserver.cc:460] Webserver started at https://127.0.0.1:35357/ using document root <none> and password file <none>
I20260807 22:38:04.585804 26833 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 22:38:04.586081 26833 webserver.cc:460] Webserver started at http://127.0.0.1:41911/ using document root <none> and password file <none>
2026-08-07T22:38:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:04Z Disabled control of system clock
I20260807 22:38:04.595381 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:33105
--webserver_interface=127.26.52.126
--webserver_port=0
--builtin_ntp_servers=127.26.52.84:34985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:33105
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35357/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/testchainca.cert with env {}
W20260807 22:38:04.703382 32469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:04.703639 32469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:04.703678 32469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:04.707736 32469 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:04.707790 32469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:04.707805 32469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:04.707821 32469 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:04.707854 32469 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:38:04.707870 32469 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:38:04.707883 32469 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35357/jwks.json
I20260807 22:38:04.713912 32469 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:34985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:33105
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:33105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35357/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:04.714947 32469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:04.715940 32469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:04.723958 32478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:04.723981 32474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:04.724149 32469 server_base.cc:1034] running on GCE node
W20260807 22:38:04.724013 32475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:04.724706 32469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:04.725797 32469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:04.726986 32469 hybrid_clock.cc:648] HybridClock initialized: now 1786142284726975 us; error 25 us; skew 500 ppm
I20260807 22:38:04.728755 32469 webserver.cc:460] Webserver started at http://127.26.52.126:36511/ using document root <none> and password file <none>
I20260807 22:38:04.729314 32469 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:04.729404 32469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:04.729630 32469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:04.731593 32469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "a84c240d52514b54a5379be9b67dcd5a"
format_stamp: "Formatted at 2026-08-07 22:38:04 on dist-test-slave-8w9v"
server_key: "abbcb6be06d8a92991d88622af8b87b1"
server_key_iv: "eae410a9e616285a77adcad099449b19"
server_key_version: "encryptionkey@0"
I20260807 22:38:04.732200 32469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "a84c240d52514b54a5379be9b67dcd5a"
format_stamp: "Formatted at 2026-08-07 22:38:04 on dist-test-slave-8w9v"
server_key: "abbcb6be06d8a92991d88622af8b87b1"
server_key_iv: "eae410a9e616285a77adcad099449b19"
server_key_version: "encryptionkey@0"
I20260807 22:38:04.735692 32469 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:38:04.738026 32484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:04.739166 32469 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:04.739310 32469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "a84c240d52514b54a5379be9b67dcd5a"
format_stamp: "Formatted at 2026-08-07 22:38:04 on dist-test-slave-8w9v"
server_key: "abbcb6be06d8a92991d88622af8b87b1"
server_key_iv: "eae410a9e616285a77adcad099449b19"
server_key_version: "encryptionkey@0"
I20260807 22:38:04.739418 32469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:04.772758 32469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:04.773469 32469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:04.773669 32469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:04.780836 32469 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:33105
I20260807 22:38:04.780860 32541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:33105 every 8 connection(s)
I20260807 22:38:04.781836 32469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:04.785073 32542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:04.790627 32542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a: Bootstrap starting.
I20260807 22:38:04.791404 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 32469
I20260807 22:38:04.791565 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:04.791828 26833 external_mini_cluster.cc:1428] Setting key 81969c942cf28303bbf2ac0885a1ad9b
I20260807 22:38:04.793542 32542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:04.794304 32542 log.cc:824] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:04.796268 32542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a: No bootstrap required, opened a new log
I20260807 22:38:04.799757 32542 raft_consensus.cc:348] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84c240d52514b54a5379be9b67dcd5a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 33105 } }
I20260807 22:38:04.799997 32542 raft_consensus.cc:374] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:04.800068 32542 raft_consensus.cc:729] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a84c240d52514b54a5379be9b67dcd5a, State: Initialized, Role: FOLLOWER
I20260807 22:38:04.800549 32542 consensus_queue.cc:260] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84c240d52514b54a5379be9b67dcd5a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 33105 } }
I20260807 22:38:04.800716 32542 raft_consensus.cc:388] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:04.800807 32542 raft_consensus.cc:482] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:04.800943 32542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:04.801184 32545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.793001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34050 (local address 127.26.52.126:33105)
0807 22:38:04.793660 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.793680 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.793727 (+ 47us) server_negotiation.cc:407] Connection header received
0807 22:38:04.794363 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.794379 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.794870 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.795287 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:04.795709 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:04.796789 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:04.797696 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:04.798166 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:04.798344 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:04.799256 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:04.799261 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:04.799273 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:04.799641 (+ 368us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:04.799692 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:04.799710 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:04.799821 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:04.799976 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 22:38:04.800285 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":136,"threads_started":1}
I20260807 22:38:04.802083 32542 raft_consensus.cc:504] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84c240d52514b54a5379be9b67dcd5a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 33105 } }
I20260807 22:38:04.802426 32542 leader_election.cc:302] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a84c240d52514b54a5379be9b67dcd5a; no voters:
I20260807 22:38:04.802747 32542 leader_election.cc:288] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:04.802822 32548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:04.803017 32548 raft_consensus.cc:686] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [term 1 LEADER]: Becoming Leader. State: Replica: a84c240d52514b54a5379be9b67dcd5a, State: Running, Role: LEADER
I20260807 22:38:04.803321 32548 consensus_queue.cc:237] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84c240d52514b54a5379be9b67dcd5a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 33105 } }
I20260807 22:38:04.804055 32542 sys_catalog.cc:564] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:04.804262 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:38:04.805084 32550 sys_catalog.cc:455] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a84c240d52514b54a5379be9b67dcd5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84c240d52514b54a5379be9b67dcd5a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 33105 } } }
I20260807 22:38:04.805124 32549 sys_catalog.cc:455] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a84c240d52514b54a5379be9b67dcd5a. Latest consensus state: current_term: 1 leader_uuid: "a84c240d52514b54a5379be9b67dcd5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a84c240d52514b54a5379be9b67dcd5a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 33105 } } }
I20260807 22:38:04.805325 32549 sys_catalog.cc:458] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:04.805359 32550 sys_catalog.cc:458] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:04.806115 32557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:04.809303 32557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:04.814841 32557 catalog_manager.cc:1347] Generated new cluster ID: a2a29d32e8c6400fbecf394ed98a604d
I20260807 22:38:04.814909 32557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:04.823549 32557 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:04.824739 32557 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:04.833235 32557 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a84c240d52514b54a5379be9b67dcd5a: Generated new TSK 0
I20260807 22:38:04.833981 32557 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 22:38:04.864506 32573 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 22:38:04.864652 32573 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 22:38:04.865175 32545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:04.847452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34066 (local address 127.26.52.126:33105)
0807 22:38:04.847588 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:04.847592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:04.847759 (+ 167us) server_negotiation.cc:407] Connection header received
0807 22:38:04.847939 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:04.847943 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:04.847997 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:04.848101 (+ 104us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:38:04.848376 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:04.849194 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:04.849962 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:04.850295 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:04.850393 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:04.850670 (+ 277us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:38:04.864791 (+ 14121us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35357/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 22:38:04.865042 (+ 251us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34066: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35357/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 22:38:04.865250 32545 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34066: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35357/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 22:38:04.866314 32572 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:04.847371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:33105 (local address 127.0.0.1:34066)
0807 22:38:04.847680 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:04.847693 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:04.847792 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:04.848158 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:04.848164 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:04.848175 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:38:04.848276 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:04.848282 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:04.849297 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:04.849299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:04.849858 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:04.849864 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:04.850403 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:04.850406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:04.850472 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:04.850509 (+ 37us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:38:04.864990 (+ 14481us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35357/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 22:38:04.865164 (+ 174us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.52.126:33105: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35357/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":115,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.52.126:33105: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35357/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 22:38:04.867367 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 32469
2026-08-07T22:38:04Z chronyd exiting
I20260807 22:38:04.907521 26833 test_util.cc:175] -----------------------------------------------
I20260807 22:38:04.907603 26833 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142258649536-26833-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (325 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 22:38:04.908810 26833 mini_oidc.cc:152] Starting JWKS server
I20260807 22:38:04.909659 26833 webserver.cc:460] Webserver started at https://127.0.0.1:44983/ using document root <none> and password file <none>
I20260807 22:38:04.909741 26833 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 22:38:04.909955 26833 webserver.cc:460] Webserver started at http://127.0.0.1:35931/ using document root <none> and password file <none>
2026-08-07T22:38:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:04Z Disabled control of system clock
I20260807 22:38:04.919378 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:42513
--webserver_interface=127.26.52.126
--webserver_port=0
--builtin_ntp_servers=127.26.52.84:35497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:42513
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44983/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/testchainca.cert with env {}
W20260807 22:38:05.030680 32579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:05.030900 32579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:05.030936 32579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:05.034873 32579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:05.034926 32579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:05.034941 32579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:05.034957 32579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:05.034972 32579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:38:05.034988 32579 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:38:05.035001 32579 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44983/jwks.json
I20260807 22:38:05.040298 32579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:42513
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:42513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44983/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:05.041231 32579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:05.042162 32579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:05.050565 32587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:05.050563 32584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:05.050580 32585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:05.050840 32579 server_base.cc:1034] running on GCE node
I20260807 22:38:05.051424 32579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:05.052505 32579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:05.053663 32579 hybrid_clock.cc:648] HybridClock initialized: now 1786142285053632 us; error 44 us; skew 500 ppm
I20260807 22:38:05.055476 32579 webserver.cc:460] Webserver started at http://127.26.52.126:34105/ using document root <none> and password file <none>
I20260807 22:38:05.056044 32579 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:05.056108 32579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:05.056392 32579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:05.058310 32579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "38e50a3b37d046648a9b231327b99bab"
format_stamp: "Formatted at 2026-08-07 22:38:05 on dist-test-slave-8w9v"
server_key: "ef6ca955dcbd60fcd371d73c07c3e9ec"
server_key_iv: "2e11a24139a65a153a85d16ca78de9ed"
server_key_version: "encryptionkey@0"
I20260807 22:38:05.058878 32579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "38e50a3b37d046648a9b231327b99bab"
format_stamp: "Formatted at 2026-08-07 22:38:05 on dist-test-slave-8w9v"
server_key: "ef6ca955dcbd60fcd371d73c07c3e9ec"
server_key_iv: "2e11a24139a65a153a85d16ca78de9ed"
server_key_version: "encryptionkey@0"
I20260807 22:38:05.062525 32579 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 22:38:05.064819 32597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:05.065970 32579 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:38:05.066118 32579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "38e50a3b37d046648a9b231327b99bab"
format_stamp: "Formatted at 2026-08-07 22:38:05 on dist-test-slave-8w9v"
server_key: "ef6ca955dcbd60fcd371d73c07c3e9ec"
server_key_iv: "2e11a24139a65a153a85d16ca78de9ed"
server_key_version: "encryptionkey@0"
I20260807 22:38:05.066227 32579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:05.080803 32579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:05.081444 32579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:05.081645 32579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:05.088593 32579 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:42513
I20260807 22:38:05.088630 32652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:42513 every 8 connection(s)
I20260807 22:38:05.089486 32579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:05.092478 32653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:05.094805 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 32579
I20260807 22:38:05.095041 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:05.095324 26833 external_mini_cluster.cc:1428] Setting key c546837ff6974ad6f95bfd162de9c3c6
I20260807 22:38:05.098229 32653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab: Bootstrap starting.
I20260807 22:38:05.100391 32653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:05.101125 32653 log.cc:824] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:05.102929 32653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab: No bootstrap required, opened a new log
I20260807 22:38:05.104420 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:05.096741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45940 (local address 127.26.52.126:42513)
0807 22:38:05.097373 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:05.097386 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:05.097419 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:38:05.097994 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:05.098008 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:05.098394 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:05.098710 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:05.099123 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.100081 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.101094 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.101605 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.101777 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:05.102647 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:05.102660 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:05.102673 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:05.103097 (+ 424us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:05.103164 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:05.103185 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:05.103289 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:05.103422 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 22:38:05.103677 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":143,"threads_started":1}
I20260807 22:38:05.106700 32653 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e50a3b37d046648a9b231327b99bab" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42513 } }
I20260807 22:38:05.106928 32653 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:05.106993 32653 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38e50a3b37d046648a9b231327b99bab, State: Initialized, Role: FOLLOWER
I20260807 22:38:05.107124 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:38:05.107472 32653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e50a3b37d046648a9b231327b99bab" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42513 } }
I20260807 22:38:05.107620 32653 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:05.107678 32653 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:05.107775 32653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:05.108726 32653 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e50a3b37d046648a9b231327b99bab" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42513 } }
I20260807 22:38:05.109067 32653 leader_election.cc:302] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38e50a3b37d046648a9b231327b99bab; no voters:
I20260807 22:38:05.109355 32653 leader_election.cc:288] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:05.109511 32658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:05.109720 32658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [term 1 LEADER]: Becoming Leader. State: Replica: 38e50a3b37d046648a9b231327b99bab, State: Running, Role: LEADER
I20260807 22:38:05.110023 32658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e50a3b37d046648a9b231327b99bab" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42513 } }
I20260807 22:38:05.110558 32653 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:05.111665 32659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38e50a3b37d046648a9b231327b99bab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e50a3b37d046648a9b231327b99bab" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42513 } } }
I20260807 22:38:05.111709 32660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38e50a3b37d046648a9b231327b99bab. Latest consensus state: current_term: 1 leader_uuid: "38e50a3b37d046648a9b231327b99bab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e50a3b37d046648a9b231327b99bab" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42513 } } }
I20260807 22:38:05.111864 32660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:05.111889 32659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:05.112277 32662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:05.116112 32662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:05.121105 32662 catalog_manager.cc:1347] Generated new cluster ID: b78885617fcb4096844d67419639314e
I20260807 22:38:05.121191 32662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:05.133752 32662 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:05.134528 32662 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:05.142074 32662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38e50a3b37d046648a9b231327b99bab: Generated new TSK 0
I20260807 22:38:05.142663 32662 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 22:38:05.169832 32686 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 22:38:05.169929 32686 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 22:38:05.170516 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:05.155012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45944 (local address 127.26.52.126:42513)
0807 22:38:05.155146 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:05.155151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:05.155329 (+ 178us) server_negotiation.cc:407] Connection header received
0807 22:38:05.155528 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:05.155534 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:05.155596 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:05.155706 (+ 110us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:38:05.155973 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.156560 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.157759 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.157968 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.158071 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:05.158407 (+ 336us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:38:05.170136 (+ 11729us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44983/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 22:38:05.170418 (+ 282us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45944: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44983/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 22:38:05.170588 32656 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45944: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44983/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 22:38:05.170616 32685 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:05.154923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:42513 (local address 127.0.0.1:45944)
0807 22:38:05.155220 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:05.155253 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:05.155370 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:05.155720 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:05.155723 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:05.155732 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:38:05.155846 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:05.155852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.156665 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.156669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:05.157643 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:05.157653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.158111 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.158115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:05.158222 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:05.158250 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:38:05.170304 (+ 12054us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44983/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 22:38:05.170455 (+ 151us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.52.126:42513: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44983/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":105,"threads_started":1}
I20260807 22:38:05.171167 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 32579
2026-08-07T22:38:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (303 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 22:38:05.212677 26833 mini_oidc.cc:152] Starting JWKS server
I20260807 22:38:05.213533 26833 webserver.cc:460] Webserver started at https://127.0.0.1:38603/ using document root <none> and password file <none>
I20260807 22:38:05.213646 26833 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 22:38:05.213940 26833 webserver.cc:460] Webserver started at http://127.0.0.1:37365/ using document root <none> and password file <none>
2026-08-07T22:38:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:05Z Disabled control of system clock
I20260807 22:38:05.223531 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:42527
--webserver_interface=127.26.52.126
--webserver_port=0
--builtin_ntp_servers=127.26.52.84:45827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:42527
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38603/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 22:38:05.333420 32692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:05.333655 32692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:05.333709 32692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:05.337692 32692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:05.337742 32692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:05.337759 32692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:05.337774 32692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:05.337790 32692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:38:05.337841 32692 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:38:05.337867 32692 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38603/jwks.json
I20260807 22:38:05.342458 32692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:42527
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:42527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38603/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:05.343461 32692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:05.344851 32692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:05.353039 32698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:05.353047 32697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:05.353066 32700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:05.353436 32692 server_base.cc:1034] running on GCE node
I20260807 22:38:05.354010 32692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:05.355013 32692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:05.356202 32692 hybrid_clock.cc:648] HybridClock initialized: now 1786142285356190 us; error 27 us; skew 500 ppm
I20260807 22:38:05.357970 32692 webserver.cc:460] Webserver started at http://127.26.52.126:46425/ using document root <none> and password file <none>
I20260807 22:38:05.358530 32692 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:05.358619 32692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:05.358829 32692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:05.360904 32692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "4c1a78579eb141d48ad1134ee43f4aa2"
format_stamp: "Formatted at 2026-08-07 22:38:05 on dist-test-slave-8w9v"
server_key: "fe150fdfa5869f6eda58a4cdf60edeb6"
server_key_iv: "cb91efdea33f0ffbc62782b9038c1184"
server_key_version: "encryptionkey@0"
I20260807 22:38:05.361455 32692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "4c1a78579eb141d48ad1134ee43f4aa2"
format_stamp: "Formatted at 2026-08-07 22:38:05 on dist-test-slave-8w9v"
server_key: "fe150fdfa5869f6eda58a4cdf60edeb6"
server_key_iv: "cb91efdea33f0ffbc62782b9038c1184"
server_key_version: "encryptionkey@0"
I20260807 22:38:05.365077 32692 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:38:05.367336 32706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:05.368557 32692 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:38:05.368702 32692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "4c1a78579eb141d48ad1134ee43f4aa2"
format_stamp: "Formatted at 2026-08-07 22:38:05 on dist-test-slave-8w9v"
server_key: "fe150fdfa5869f6eda58a4cdf60edeb6"
server_key_iv: "cb91efdea33f0ffbc62782b9038c1184"
server_key_version: "encryptionkey@0"
I20260807 22:38:05.368810 32692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:05.406360 32692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:05.407132 32692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:05.407347 32692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:05.415289 32692 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:42527
I20260807 22:38:05.415330 32766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:42527 every 8 connection(s)
I20260807 22:38:05.416493 32692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:05.419432 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 32692
I20260807 22:38:05.419476 32767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:05.419552 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:05.419862 26833 external_mini_cluster.cc:1428] Setting key d43f25f58facb544f0728ee7dc24f49c
I20260807 22:38:05.426251 32767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2: Bootstrap starting.
I20260807 22:38:05.428745 32767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:05.429138 303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:05.421272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36962 (local address 127.26.52.126:42527)
0807 22:38:05.421908 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:05.421924 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:05.421957 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:38:05.422684 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:05.422701 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:05.423065 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:05.423364 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:05.423709 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.424791 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.425993 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.426482 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.426592 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:05.427430 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:05.427435 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:05.427446 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:05.427790 (+ 344us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:05.427842 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:05.427859 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:05.427935 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:05.428117 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 22:38:05.428435 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":318,"thread_start_us":135,"threads_started":1}
I20260807 22:38:05.429512 32767 log.cc:824] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:05.431551 32767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2: No bootstrap required, opened a new log
I20260807 22:38:05.431861 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:38:05.435134 32767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c1a78579eb141d48ad1134ee43f4aa2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42527 } }
I20260807 22:38:05.435325 32767 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:05.435397 32767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c1a78579eb141d48ad1134ee43f4aa2, State: Initialized, Role: FOLLOWER
I20260807 22:38:05.435819 32767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c1a78579eb141d48ad1134ee43f4aa2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42527 } }
I20260807 22:38:05.435981 32767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:05.436051 32767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:05.436211 32767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:05.437052 32767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c1a78579eb141d48ad1134ee43f4aa2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42527 } }
I20260807 22:38:05.437371 32767 leader_election.cc:302] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c1a78579eb141d48ad1134ee43f4aa2; no voters:
I20260807 22:38:05.437692 32767 leader_election.cc:288] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:05.437816 305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:05.438095 305 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [term 1 LEADER]: Becoming Leader. State: Replica: 4c1a78579eb141d48ad1134ee43f4aa2, State: Running, Role: LEADER
I20260807 22:38:05.438377 305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c1a78579eb141d48ad1134ee43f4aa2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42527 } }
I20260807 22:38:05.438962 32767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:05.440200 306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c1a78579eb141d48ad1134ee43f4aa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c1a78579eb141d48ad1134ee43f4aa2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42527 } } }
I20260807 22:38:05.440353 306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:05.440594 307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c1a78579eb141d48ad1134ee43f4aa2. Latest consensus state: current_term: 1 leader_uuid: "4c1a78579eb141d48ad1134ee43f4aa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c1a78579eb141d48ad1134ee43f4aa2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 42527 } } }
I20260807 22:38:05.440703 307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:05.441143 314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:05.443636 314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:05.448963 314 catalog_manager.cc:1347] Generated new cluster ID: e92c429d588b46f0a7975714c2733b44
I20260807 22:38:05.449026 314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:05.459020 314 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:05.460145 314 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:05.465350 314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c1a78579eb141d48ad1134ee43f4aa2: Generated new TSK 0
I20260807 22:38:05.466092 314 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:38:05.487905 303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:05.482953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36978 (local address 127.26.52.126:42527)
0807 22:38:05.483088 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:05.483093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:05.483238 (+ 145us) server_negotiation.cc:407] Connection header received
0807 22:38:05.483375 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:05.483378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:05.483432 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:05.483540 (+ 108us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:38:05.483737 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.484585 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.485431 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.485765 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.485864 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:05.486163 (+ 299us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:38:05.487549 (+ 1386us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38603/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 22:38:05.487768 (+ 219us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36978: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38603/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 22:38:05.487984 303 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36978: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38603/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 22:38:05.489778 331 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:05.482721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:42527 (local address 127.0.0.1:36978)
0807 22:38:05.483155 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:05.483167 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:05.483257 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:05.483543 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:05.483545 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:05.483551 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:38:05.483642 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:05.483646 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.484679 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.484681 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:05.485324 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:05.485331 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.485888 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.485891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:05.485958 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:05.485978 (+ 20us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:38:05.487710 (+ 1732us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38603/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 22:38:05.489608 (+ 1898us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.52.126:42527: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38603/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":1702,"thread_start_us":111,"threads_started":1}
I20260807 22:38:05.490439 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 32692
E20260807 22:38:05.499792 332 webserver.cc:533] Webserver: sslize failed:
E20260807 22:38:05.499851 332 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T22:38:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (318 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T22:38:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:05Z Disabled control of system clock
I20260807 22:38:05.540848 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:41653
--webserver_interface=127.26.52.126
--webserver_port=0
--builtin_ntp_servers=127.26.52.84:36985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:41653
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/testchainca.cert with env {}
W20260807 22:38:05.650516 337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:05.650767 337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:05.650808 337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:05.654796 337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:05.654852 337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:05.654870 337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:05.654889 337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:05.654954 337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:38:05.654996 337 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:38:05.655043 337 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 22:38:05.660431 337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:36985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:41653
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:41653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:05.661468 337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:05.662526 337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:05.670899 343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:05.670946 342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:05.670917 337 server_base.cc:1034] running on GCE node
W20260807 22:38:05.670946 345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:05.671680 337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:05.672788 337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:05.673977 337 hybrid_clock.cc:648] HybridClock initialized: now 1786142285673951 us; error 39 us; skew 500 ppm
I20260807 22:38:05.675860 337 webserver.cc:460] Webserver started at http://127.26.52.126:45693/ using document root <none> and password file <none>
I20260807 22:38:05.676508 337 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:05.676600 337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:05.676831 337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:05.678828 337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "99ecbfc217874eca9e3331d5d79d5f92"
format_stamp: "Formatted at 2026-08-07 22:38:05 on dist-test-slave-8w9v"
server_key: "fc9cc35c7cf82f3ce3759c2c9323b107"
server_key_iv: "b59e0b395bdfdd324db2173c85b7af61"
server_key_version: "encryptionkey@0"
I20260807 22:38:05.679402 337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "99ecbfc217874eca9e3331d5d79d5f92"
format_stamp: "Formatted at 2026-08-07 22:38:05 on dist-test-slave-8w9v"
server_key: "fc9cc35c7cf82f3ce3759c2c9323b107"
server_key_iv: "b59e0b395bdfdd324db2173c85b7af61"
server_key_version: "encryptionkey@0"
I20260807 22:38:05.682958 337 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:38:05.685304 351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:05.686523 337 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:38:05.686667 337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "99ecbfc217874eca9e3331d5d79d5f92"
format_stamp: "Formatted at 2026-08-07 22:38:05 on dist-test-slave-8w9v"
server_key: "fc9cc35c7cf82f3ce3759c2c9323b107"
server_key_iv: "b59e0b395bdfdd324db2173c85b7af61"
server_key_version: "encryptionkey@0"
I20260807 22:38:05.686776 337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:05.708521 337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:05.709255 337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:05.709472 337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:05.717640 337 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:41653
I20260807 22:38:05.717659 407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:41653 every 8 connection(s)
I20260807 22:38:05.718597 337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:05.721527 408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:05.726838 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 337
I20260807 22:38:05.726967 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:05.727317 408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92: Bootstrap starting.
I20260807 22:38:05.727345 26833 external_mini_cluster.cc:1428] Setting key d6b6e97656d20516c95fb606b9099b2d
I20260807 22:38:05.729959 408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:05.730718 408 log.cc:824] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:05.732738 408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92: No bootstrap required, opened a new log
I20260807 22:38:05.736083 408 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecbfc217874eca9e3331d5d79d5f92" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41653 } }
I20260807 22:38:05.736263 411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:05.728644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48688 (local address 127.26.52.126:41653)
0807 22:38:05.729266 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:05.729281 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:05.729314 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:38:05.729892 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:05.729908 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:05.730310 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:05.730613 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:05.731019 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.732183 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.733148 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.733597 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.733787 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:05.734589 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:05.734594 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:05.734604 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:05.734962 (+ 358us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:05.735012 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:05.735030 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:05.735136 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:05.735267 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 22:38:05.735495 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":132,"threads_started":1}
I20260807 22:38:05.736374 408 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:05.736471 408 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ecbfc217874eca9e3331d5d79d5f92, State: Initialized, Role: FOLLOWER
I20260807 22:38:05.736922 408 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecbfc217874eca9e3331d5d79d5f92" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41653 } }
I20260807 22:38:05.737073 408 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:05.737123 408 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:05.737226 408 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:05.738076 408 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecbfc217874eca9e3331d5d79d5f92" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41653 } }
I20260807 22:38:05.738432 408 leader_election.cc:302] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99ecbfc217874eca9e3331d5d79d5f92; no voters:
I20260807 22:38:05.738714 408 leader_election.cc:288] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:05.738816 414 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:05.739054 414 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [term 1 LEADER]: Becoming Leader. State: Replica: 99ecbfc217874eca9e3331d5d79d5f92, State: Running, Role: LEADER
I20260807 22:38:05.739322 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:38:05.739352 414 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecbfc217874eca9e3331d5d79d5f92" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41653 } }
I20260807 22:38:05.739944 408 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:05.740306 414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99ecbfc217874eca9e3331d5d79d5f92. Latest consensus state: current_term: 1 leader_uuid: "99ecbfc217874eca9e3331d5d79d5f92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecbfc217874eca9e3331d5d79d5f92" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41653 } } }
I20260807 22:38:05.740427 414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:05.740783 415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99ecbfc217874eca9e3331d5d79d5f92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99ecbfc217874eca9e3331d5d79d5f92" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41653 } } }
I20260807 22:38:05.740880 415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92 [sys.catalog]: This master's current role is: LEADER
W20260807 22:38:05.745087 430 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:38:05.745172 430 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:38:05.747742 418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:05.748755 418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:05.754745 418 catalog_manager.cc:1347] Generated new cluster ID: c735919819a64e7eb999c5b551c6a29c
I20260807 22:38:05.754822 418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:05.788384 418 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:05.789808 418 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:05.801410 418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99ecbfc217874eca9e3331d5d79d5f92: Generated new TSK 0
I20260807 22:38:05.802109 418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:38:06.246294 411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:05.819589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48694 (local address 127.26.52.126:41653)
0807 22:38:05.819730 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:05.819734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:05.819939 (+ 205us) server_negotiation.cc:407] Connection header received
0807 22:38:05.820154 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:05.820159 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:05.820218 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:05.820302 (+ 84us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:38:05.820574 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.821085 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.822315 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.822531 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.822615 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:05.822938 (+ 323us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:38:06.245897 (+422959us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 22:38:06.246170 (+ 273us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48694: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":53}
W20260807 22:38:06.246405 411 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48694: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 22:38:06.246861 441 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:05.819535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41653 (local address 127.0.0.1:48694)
0807 22:38:05.819846 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:05.819861 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:05.819983 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:05.820327 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:05.820330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:05.820339 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:38:05.820462 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:05.820468 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.821203 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.821207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:05.822206 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:05.822216 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:05.822658 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:05.822662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:05.822748 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:05.822774 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:38:06.246152 (+423378us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 22:38:06.246343 (+ 191us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.52.126:41653: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":124,"threads_started":1}
I20260807 22:38:06.247505 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 337
2026-08-07T22:38:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (738 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (121 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (124 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:38:06 dist-test-slave-8w9v krb5kdc[454](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:38:06 dist-test-slave-8w9v krb5kdc[454](info): set up 2 sockets
Aug 07 22:38:06 dist-test-slave-8w9v krb5kdc[454](info): commencing operation
krb5kdc: starting...
W20260807 22:38:07.558097 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:38:07 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:38:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:38:07.676666 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40505
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:40505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:07.788725 468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:07.788988 468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:07.789053 468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:07.793077 468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:07.793135 468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:07.793154 468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:07.793171 468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:07.793221 468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:07.798482 468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:40505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:07.799548 468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:07.800643 468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:07.809391 474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:07.809489 468 server_base.cc:1034] running on GCE node
W20260807 22:38:07.809371 473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:07.809376 476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:07.810267 468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:07.811352 468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:07.812520 468 hybrid_clock.cc:648] HybridClock initialized: now 1786142287812499 us; error 32 us; skew 500 ppm
Aug 07 22:38:07 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142287, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:07.818238 468 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:38:07.819185 468 webserver.cc:460] Webserver started at http://127.26.52.126:43145/ using document root <none> and password file <none>
I20260807 22:38:07.819738 468 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:07.819804 468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:07.819972 468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:07.822067 468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "0eec784445554f00a88723dd863ed5ee"
format_stamp: "Formatted at 2026-08-07 22:38:07 on dist-test-slave-8w9v"
server_key: "6db54a1e1759bb52c43c853c6b56322a"
server_key_iv: "85971ac11dba4477a89ea9956e2eff5c"
server_key_version: "encryptionkey@0"
I20260807 22:38:07.822579 468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "0eec784445554f00a88723dd863ed5ee"
format_stamp: "Formatted at 2026-08-07 22:38:07 on dist-test-slave-8w9v"
server_key: "6db54a1e1759bb52c43c853c6b56322a"
server_key_iv: "85971ac11dba4477a89ea9956e2eff5c"
server_key_version: "encryptionkey@0"
I20260807 22:38:07.826241 468 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:38:07.828536 485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:07.829726 468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:07.829885 468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "0eec784445554f00a88723dd863ed5ee"
format_stamp: "Formatted at 2026-08-07 22:38:07 on dist-test-slave-8w9v"
server_key: "6db54a1e1759bb52c43c853c6b56322a"
server_key_iv: "85971ac11dba4477a89ea9956e2eff5c"
server_key_version: "encryptionkey@0"
I20260807 22:38:07.829988 468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:07.843098 468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:07.845785 468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:07.845983 468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:07.853077 468 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:40505
I20260807 22:38:07.853147 541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:40505 every 8 connection(s)
I20260807 22:38:07.854060 468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:07.856768 542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:07.862219 542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee: Bootstrap starting.
I20260807 22:38:07.862833 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 468
I20260807 22:38:07.862965 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:07.863247 26833 external_mini_cluster.cc:1428] Setting key 479f60343d739178ee16af16417c1800
I20260807 22:38:07.865206 542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:07.865950 542 log.cc:824] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:07.868007 542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee: No bootstrap required, opened a new log
Aug 07 22:38:07 dist-test-slave-8w9v krb5kdc[454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:07.872465 542 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eec784445554f00a88723dd863ed5ee" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40505 } }
I20260807 22:38:07.872663 542 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:07.872726 542 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eec784445554f00a88723dd863ed5ee, State: Initialized, Role: FOLLOWER
I20260807 22:38:07.873194 542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eec784445554f00a88723dd863ed5ee" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40505 } }
I20260807 22:38:07.873369 542 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:07.873494 542 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:07.873626 542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:07.874543 542 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eec784445554f00a88723dd863ed5ee" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40505 } }
I20260807 22:38:07.874907 542 leader_election.cc:302] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0eec784445554f00a88723dd863ed5ee; no voters:
I20260807 22:38:07.875233 542 leader_election.cc:288] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:07.875345 547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:07.875607 547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [term 1 LEADER]: Becoming Leader. State: Replica: 0eec784445554f00a88723dd863ed5ee, State: Running, Role: LEADER
I20260807 22:38:07.875936 547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eec784445554f00a88723dd863ed5ee" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40505 } }
I20260807 22:38:07.876659 542 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:07.877795 549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0eec784445554f00a88723dd863ed5ee. Latest consensus state: current_term: 1 leader_uuid: "0eec784445554f00a88723dd863ed5ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eec784445554f00a88723dd863ed5ee" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40505 } } }
I20260807 22:38:07.877911 549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:07.877944 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:07.864669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43126 (local address 127.26.52.126:40505)
0807 22:38:07.865097 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:07.865112 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:07.865148 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:38:07.865832 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:07.865848 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:07.866209 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:07.866576 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:07.867434 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:07.868454 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:07.869579 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:07.870011 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:07.870121 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:07.872914 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:07.872918 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:07.872929 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:07.872955 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:07.874641 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:07.875146 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:07.875150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:07.875154 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:07.875309 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:07.875629 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:07.875632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:07.875634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:07.876142 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:07.876348 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:07.876650 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 22:38:07.876951 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":129,"threads_started":1}
I20260807 22:38:07.878202 548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0eec784445554f00a88723dd863ed5ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eec784445554f00a88723dd863ed5ee" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40505 } } }
I20260807 22:38:07.878297 548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:07.879995 556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:07.882506 556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:07.887535 556 catalog_manager.cc:1347] Generated new cluster ID: adaff55dd0fd470a868e0758b9dbe77b
I20260807 22:38:07.887598 556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:07.908043 556 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:07.909107 556 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:07.913041 556 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0eec784445554f00a88723dd863ed5ee: Generated new TSK 0
I20260807 22:38:07.913743 556 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:38:07.949443 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40505
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:08.059422 568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:08.059652 568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:08.059692 568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:08.063625 568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:08.063673 568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:08.063761 568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:08.068641 568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:08.069511 568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:08.070418 568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:08.079767 576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:08.079798 573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:08.080017 568 server_base.cc:1034] running on GCE node
W20260807 22:38:08.080211 574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:08.080591 568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:08.081174 568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:08.082327 568 hybrid_clock.cc:648] HybridClock initialized: now 1786142288082305 us; error 34 us; skew 500 ppm
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:08.085058 568 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:38:08.085922 568 webserver.cc:460] Webserver started at http://127.26.52.65:45343/ using document root <none> and password file <none>
I20260807 22:38:08.086477 568 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:08.086567 568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:08.086781 568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:08.088789 568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "66dafbbd4b22493abd418e0a9b97da95"
format_stamp: "Formatted at 2026-08-07 22:38:08 on dist-test-slave-8w9v"
server_key: "b14e55eee7dc06f5f26d8967e19daa2c"
server_key_iv: "543a11af81918c34cd358964c7dc218e"
server_key_version: "encryptionkey@0"
I20260807 22:38:08.089331 568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "66dafbbd4b22493abd418e0a9b97da95"
format_stamp: "Formatted at 2026-08-07 22:38:08 on dist-test-slave-8w9v"
server_key: "b14e55eee7dc06f5f26d8967e19daa2c"
server_key_iv: "543a11af81918c34cd358964c7dc218e"
server_key_version: "encryptionkey@0"
I20260807 22:38:08.092883 568 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:38:08.095078 583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:08.096248 568 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:08.096375 568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "66dafbbd4b22493abd418e0a9b97da95"
format_stamp: "Formatted at 2026-08-07 22:38:08 on dist-test-slave-8w9v"
server_key: "b14e55eee7dc06f5f26d8967e19daa2c"
server_key_iv: "543a11af81918c34cd358964c7dc218e"
server_key_version: "encryptionkey@0"
I20260807 22:38:08.096488 568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:08.110275 568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:08.113582 568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:08.113808 568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:08.114444 568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:08.115288 568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:08.115356 568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:08.115414 568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:08.115444 568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:08.124323 568 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:33487
I20260807 22:38:08.124354 707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:33487 every 8 connection(s)
I20260807 22:38:08.125181 568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:08.125698 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 568
I20260807 22:38:08.125834 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:38:08.126129 26833 external_mini_cluster.cc:1428] Setting key 9b647fc4cdf62cdfd847a34dcbb78006
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:38:08.140792 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:08.127374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:57353 (local address 127.26.52.126:40505)
0807 22:38:08.127529 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:08.127534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:08.128507 (+ 973us) server_negotiation.cc:407] Connection header received
0807 22:38:08.130406 (+ 1899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:08.130413 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:08.130483 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:08.130581 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:08.131902 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.132491 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.134276 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.134508 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.134627 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:08.137323 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:08.137329 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:08.137334 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:08.137369 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:08.138784 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.139256 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.139258 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.139259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.139331 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.139693 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.139695 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.139696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.139855 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:08.139931 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:08.140546 (+ 615us) server_negotiation.cc:299] Negotiation successful
0807 22:38:08.140669 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:38:08.141928 710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:08.127834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40505 (local address 127.26.52.65:57353)
0807 22:38:08.128349 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:08.128405 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:08.130197 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:08.130726 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:08.130732 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:08.131063 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:08.131741 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:08.131763 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.132618 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.132624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:08.134152 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:08.134167 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.134669 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.134676 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:08.134905 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:08.135503 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:08.135531 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:08.137151 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:08.138898 (+ 1747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:08.138903 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:08.138913 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:08.139167 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:08.139411 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:08.139413 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:08.139415 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:08.139594 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:08.139946 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:08.139950 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:08.140268 (+ 318us) client_negotiation.cc:769] Sending connection context
0807 22:38:08.140472 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 22:38:08.140788 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":115,"threads_started":1}
I20260807 22:38:08.143200 708 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40505
I20260807 22:38:08.143463 708 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:08.143958 708 heartbeater.cc:511] Master 127.26.52.126:40505 requested a full tablet report, sending...
I20260807 22:38:08.145572 504 ts_manager.cc:194] Registered new tserver with Master: 66dafbbd4b22493abd418e0a9b97da95 (127.26.52.65:33487)
I20260807 22:38:08.146682 504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:57353
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:38:08.155140 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40505
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:08.263115 713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:08.263363 713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:08.263403 713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:08.267372 713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:08.267434 713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:08.267537 713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:08.272521 713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:08.273546 713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:08.274569 713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:08.284400 718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:08.284400 719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:08.284710 713 server_base.cc:1034] running on GCE node
W20260807 22:38:08.284442 721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:08.285173 713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:08.285818 713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:08.287006 713 hybrid_clock.cc:648] HybridClock initialized: now 1786142288286976 us; error 46 us; skew 500 ppm
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:08.289785 713 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:38:08.290584 713 webserver.cc:460] Webserver started at http://127.26.52.66:35013/ using document root <none> and password file <none>
I20260807 22:38:08.291132 713 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:08.291224 713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:08.291462 713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:08.293509 713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "5b0e0a7d8cb0404e89ba82234ba90d41"
format_stamp: "Formatted at 2026-08-07 22:38:08 on dist-test-slave-8w9v"
server_key: "efcef8d4d42dc4925aa90f960c508e6d"
server_key_iv: "49ad593f66b9e8ab7d841676d609dade"
server_key_version: "encryptionkey@0"
I20260807 22:38:08.294064 713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "5b0e0a7d8cb0404e89ba82234ba90d41"
format_stamp: "Formatted at 2026-08-07 22:38:08 on dist-test-slave-8w9v"
server_key: "efcef8d4d42dc4925aa90f960c508e6d"
server_key_iv: "49ad593f66b9e8ab7d841676d609dade"
server_key_version: "encryptionkey@0"
I20260807 22:38:08.297689 713 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:38:08.300088 730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:08.301263 713 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:08.301389 713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "5b0e0a7d8cb0404e89ba82234ba90d41"
format_stamp: "Formatted at 2026-08-07 22:38:08 on dist-test-slave-8w9v"
server_key: "efcef8d4d42dc4925aa90f960c508e6d"
server_key_iv: "49ad593f66b9e8ab7d841676d609dade"
server_key_version: "encryptionkey@0"
I20260807 22:38:08.301509 713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:08.321830 713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:08.325007 713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:08.325212 713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:08.325798 713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:08.326601 713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:08.326670 713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:08.326740 713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:08.326793 713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:08.335707 713 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:38521
I20260807 22:38:08.335739 854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:38521 every 8 connection(s)
I20260807 22:38:08.336617 713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:08.341686 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 713
I20260807 22:38:08.341817 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:38:08.342175 26833 external_mini_cluster.cc:1428] Setting key c5e4d2fefe07eeb8708325bc267aa447
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:08.350629 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:08.338370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:42285 (local address 127.26.52.126:40505)
0807 22:38:08.338504 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:08.338508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:08.339229 (+ 721us) server_negotiation.cc:407] Connection header received
0807 22:38:08.340651 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:08.340654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:08.340712 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:08.340807 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:08.342014 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.342716 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.343931 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.344210 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.344291 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:08.346834 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:08.346840 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:08.346846 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:08.346877 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:08.348674 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.349129 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.349135 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.349140 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.349227 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.349553 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.349558 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.349563 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.349815 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:08.349925 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:08.350313 (+ 388us) server_negotiation.cc:299] Negotiation successful
0807 22:38:08.350451 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:38:08.351230 857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:08.338672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40505 (local address 127.26.52.66:42285)
0807 22:38:08.339088 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:08.339127 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:08.340462 (+ 1335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:08.340967 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:08.340972 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:08.341300 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:08.341771 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:08.341793 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.342849 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.342853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:08.343801 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:08.343813 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.344359 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.344366 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:08.344602 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:08.345141 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:08.345165 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:08.346682 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:08.348794 (+ 2112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:08.348798 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:08.348807 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:08.349032 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:08.349321 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:08.349324 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:08.349325 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:08.349444 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:08.349913 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:08.349917 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:08.350099 (+ 182us) client_negotiation.cc:769] Sending connection context
0807 22:38:08.350232 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 22:38:08.350450 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":126,"threads_started":1}
I20260807 22:38:08.352312 855 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40505
I20260807 22:38:08.352586 855 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:38:08.353062 855 heartbeater.cc:511] Master 127.26.52.126:40505 requested a full tablet report, sending...
I20260807 22:38:08.354102 504 ts_manager.cc:194] Registered new tserver with Master: 5b0e0a7d8cb0404e89ba82234ba90d41 (127.26.52.66:38521)
I20260807 22:38:08.354653 504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:42285
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:38:08.369302 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40505
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:08.479725 861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:08.479952 861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:08.480024 861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:08.483983 861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:08.484038 861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:08.484093 861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:08.489138 861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:08.490096 861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:08.491055 861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:08.500399 869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:08.500432 867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:08.500432 866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:08.500671 861 server_base.cc:1034] running on GCE node
I20260807 22:38:08.501169 861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:08.501760 861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:08.502950 861 hybrid_clock.cc:648] HybridClock initialized: now 1786142288502917 us; error 45 us; skew 500 ppm
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:08.505736 861 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:38:08.506614 861 webserver.cc:460] Webserver started at http://127.26.52.67:46679/ using document root <none> and password file <none>
I20260807 22:38:08.507175 861 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:08.507266 861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:08.507496 861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:08.509663 861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "8ec84993fc5d4f5a8e1cdb13156f4f2f"
format_stamp: "Formatted at 2026-08-07 22:38:08 on dist-test-slave-8w9v"
server_key: "dbb3af8f2df17a1904772b7586f3ba30"
server_key_iv: "e4374ccbdaf8cd4dc099b976872d10c6"
server_key_version: "encryptionkey@0"
I20260807 22:38:08.510273 861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "8ec84993fc5d4f5a8e1cdb13156f4f2f"
format_stamp: "Formatted at 2026-08-07 22:38:08 on dist-test-slave-8w9v"
server_key: "dbb3af8f2df17a1904772b7586f3ba30"
server_key_iv: "e4374ccbdaf8cd4dc099b976872d10c6"
server_key_version: "encryptionkey@0"
I20260807 22:38:08.513867 861 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:38:08.516273 876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:08.517606 861 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:08.517726 861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "8ec84993fc5d4f5a8e1cdb13156f4f2f"
format_stamp: "Formatted at 2026-08-07 22:38:08 on dist-test-slave-8w9v"
server_key: "dbb3af8f2df17a1904772b7586f3ba30"
server_key_iv: "e4374ccbdaf8cd4dc099b976872d10c6"
server_key_version: "encryptionkey@0"
I20260807 22:38:08.517822 861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:08.545464 861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:08.548391 861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:08.548597 861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:08.549189 861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:08.550001 861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:08.550046 861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:08.550115 861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:08.550154 861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:08.558543 861 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:42879
I20260807 22:38:08.558612 996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:42879 every 8 connection(s)
I20260807 22:38:08.559473 861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:38:08.565402 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 861
I20260807 22:38:08.565528 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:38:08.565793 26833 external_mini_cluster.cc:1428] Setting key f19985a507db50332e5d015facd9901a
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:08.572996 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:08.561278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:35303 (local address 127.26.52.126:40505)
0807 22:38:08.561444 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:08.561448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:08.562284 (+ 836us) server_negotiation.cc:407] Connection header received
0807 22:38:08.563542 (+ 1258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:08.563545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:08.563590 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:08.563658 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:08.564810 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.565342 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.566755 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.567049 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.567144 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:08.569645 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:08.569648 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:08.569650 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:08.569673 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:08.571109 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.571557 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.571560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.571561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.571629 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.571924 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.571926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.571927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.572086 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:08.572242 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:08.572695 (+ 453us) server_negotiation.cc:299] Negotiation successful
0807 22:38:08.572810 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 22:38:08.573738 1000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:08.561696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40505 (local address 127.26.52.67:35303)
0807 22:38:08.562136 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:08.562174 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:08.563350 (+ 1176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:08.563802 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:08.563807 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:08.564204 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:08.564678 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:08.564691 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.565521 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.565527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:08.566572 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:08.566582 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.567209 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.567213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:08.567368 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:08.567952 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:08.567969 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:08.569494 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:08.571207 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:08.571212 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:08.571223 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:08.571473 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:08.571708 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:08.571710 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:08.571712 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:08.571847 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:08.572251 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:08.572255 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:08.572475 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 22:38:08.572625 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 22:38:08.572882 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":120,"threads_started":1}
I20260807 22:38:08.574806 997 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40505
I20260807 22:38:08.575042 997 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:08.575520 997 heartbeater.cc:511] Master 127.26.52.126:40505 requested a full tablet report, sending...
I20260807 22:38:08.576576 504 ts_manager.cc:194] Registered new tserver with Master: 8ec84993fc5d4f5a8e1cdb13156f4f2f (127.26.52.67:42879)
I20260807 22:38:08.577121 504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:35303
I20260807 22:38:08.579509 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/test-admin.keytab.
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:08.596738 26833 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 22:38:08.599552 1005 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:08.598100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35988 (local address 127.26.52.65:33487)
0807 22:38:08.598459 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:08.598475 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:08.598503 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:38:08.598564 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:08.598570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:08.598783 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:08.598902 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:08.599333 (+ 431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35988: BlockingRecv error: recv got EOF from 127.0.0.1:35988 (error 108)
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":109,"threads_started":1}
W20260807 22:38:08.599632 26833 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5cc' of type FILE
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:08.600708 26833 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:08.601663 26833 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:38:08.610980 1005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:08.602481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36000 (local address 127.26.52.65:33487)
0807 22:38:08.602616 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:08.602620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:08.602633 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:38:08.602737 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:08.602739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:08.602788 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:08.602853 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:08.603358 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.604172 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.605137 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.605570 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.605664 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:08.607876 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:08.607884 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:08.607898 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:08.607920 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:08.609383 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.609773 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.609778 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.609779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.609853 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.610083 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.610086 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.610087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.610308 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:08.610463 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:08.610644 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 22:38:08.610822 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 22:38:08.614830 1005 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:08.613800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36014 (local address 127.26.52.65:33487)
0807 22:38:08.613939 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:08.613943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:08.614046 (+ 103us) server_negotiation.cc:407] Connection header received
0807 22:38:08.614207 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:08.614210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:08.614254 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:08.614333 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:08.614713 (+ 380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36014: BlockingRecv error: recv got EOF from 127.0.0.1:36014 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260807 22:38:08.614975 26833 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5cc' of type FILE
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:08.615937 26833 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:08.616945 26833 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:38:08.625110 1005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:08.617688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36024 (local address 127.26.52.65:33487)
0807 22:38:08.617804 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:08.617810 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:08.617890 (+ 80us) server_negotiation.cc:407] Connection header received
0807 22:38:08.618027 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:08.618030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:08.618064 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:08.618150 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:08.618598 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.619075 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.619848 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.620082 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.620265 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:08.622546 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:08.622548 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:08.622550 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:08.622571 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:08.623703 (+ 1132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.624059 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.624061 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.624062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.624177 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.624406 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.624408 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.624409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.624552 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:08.624641 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:08.624828 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 22:38:08.624939 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 22:38:08.627406 1005 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:08.626637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36036 (local address 127.26.52.65:33487)
0807 22:38:08.626735 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:08.626739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:08.626815 (+ 76us) server_negotiation.cc:407] Connection header received
0807 22:38:08.626899 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:08.626901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:08.626940 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:08.626994 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:08.627293 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36036: BlockingRecv error: recv got EOF from 127.0.0.1:36036 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 22:38:08.627750 26833 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142258649536-26833-0/krb5kdc/krb5cc)
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:08.628713 26833 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:08.629568 26833 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:38:08.637208 1005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:08.630306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36050 (local address 127.26.52.65:33487)
0807 22:38:08.630442 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:08.630445 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:08.630456 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:38:08.630543 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:08.630545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:08.630575 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:08.630636 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:08.631056 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.631520 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.632285 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:08.632492 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:08.632590 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:08.634660 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:08.634663 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:08.634664 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:08.634684 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:08.635779 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.636227 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.636230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.636231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.636297 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:08.636528 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:08.636530 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:08.636531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:08.636663 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:08.636750 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:08.636936 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 22:38:08.637045 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:38:08.638166 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 568
I20260807 22:38:08.647338 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 713
I20260807 22:38:08.656836 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 861
I20260807 22:38:08.663893 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 468
2026-08-07T22:38:08Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2170 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[1019](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[1019](info): set up 2 sockets
Aug 07 22:38:08 dist-test-slave-8w9v krb5kdc[1019](info): commencing operation
krb5kdc: starting...
W20260807 22:38:09.734802 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:38:09 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:38:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:09Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.126.keytab.
Entry for principal oryx/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.126.keytab.
I20260807 22:38:09.860760 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:46847
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.126.keytab
--principal=oryx/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:46847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:09.974359 1033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:09.974664 1033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:09.974737 1033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:09.978768 1033 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:09.978870 1033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:09.978911 1033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:09.978972 1033 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:09.979013 1033 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:09.984337 1033 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:46847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.126.keytab
--principal=oryx/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:46847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:09.985476 1033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:09.986536 1033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:09.995195 1039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:09.995226 1041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:09.995190 1038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:09.995468 1033 server_base.cc:1034] running on GCE node
I20260807 22:38:09.996218 1033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:09.997289 1033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:09.998482 1033 hybrid_clock.cc:648] HybridClock initialized: now 1786142289998468 us; error 26 us; skew 500 ppm
Aug 07 22:38:09 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142289, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:10.001179 1033 init.cc:377] Logged in from keytab as oryx/127.26.52.126@KRBTEST.COM (short username oryx)
I20260807 22:38:10.002009 1033 webserver.cc:460] Webserver started at http://127.26.52.126:38231/ using document root <none> and password file <none>
I20260807 22:38:10.002528 1033 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:10.002586 1033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:10.002753 1033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:10.004885 1033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "2afb5413a1a64afda69760b6e02373b6"
format_stamp: "Formatted at 2026-08-07 22:38:09 on dist-test-slave-8w9v"
server_key: "59e05ade9f0199154be4c21aee7ab352"
server_key_iv: "96f432142fcf3c24b3d8360071d2a727"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.005393 1033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "2afb5413a1a64afda69760b6e02373b6"
format_stamp: "Formatted at 2026-08-07 22:38:09 on dist-test-slave-8w9v"
server_key: "59e05ade9f0199154be4c21aee7ab352"
server_key_iv: "96f432142fcf3c24b3d8360071d2a727"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.009327 1033 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:38:10.011734 1048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:10.013037 1033 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:10.013181 1033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "2afb5413a1a64afda69760b6e02373b6"
format_stamp: "Formatted at 2026-08-07 22:38:09 on dist-test-slave-8w9v"
server_key: "59e05ade9f0199154be4c21aee7ab352"
server_key_iv: "96f432142fcf3c24b3d8360071d2a727"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.013286 1033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:10.036500 1033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:10.039570 1033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:10.039779 1033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:10.047188 1033 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:46847
I20260807 22:38:10.047497 1103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:46847 every 8 connection(s)
I20260807 22:38:10.048246 1033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:10.050962 1104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:10.056313 1104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6: Bootstrap starting.
I20260807 22:38:10.057196 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 1033
I20260807 22:38:10.057335 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:10.057662 26833 external_mini_cluster.cc:1428] Setting key 73ca70f4b52bb33f61cee830c4509978
I20260807 22:38:10.059221 1104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:10.059938 1104 log.cc:824] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:10.061784 1104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6: No bootstrap required, opened a new log
I20260807 22:38:10.065361 1104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } }
I20260807 22:38:10.065594 1104 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:10.065678 1104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afb5413a1a64afda69760b6e02373b6, State: Initialized, Role: FOLLOWER
Aug 07 22:38:10 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:10.066098 1104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } }
I20260807 22:38:10.066319 1104 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:10.066391 1104 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:10.066493 1104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:10.067672 1104 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } }
I20260807 22:38:10.068040 1104 leader_election.cc:302] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2afb5413a1a64afda69760b6e02373b6; no voters:
I20260807 22:38:10.068462 1104 leader_election.cc:288] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:10.068542 1111 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:10.068792 1111 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 1 LEADER]: Becoming Leader. State: Replica: 2afb5413a1a64afda69760b6e02373b6, State: Running, Role: LEADER
I20260807 22:38:10.069152 1111 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } }
I20260807 22:38:10.069823 1104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:10.070868 1112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } }
I20260807 22:38:10.071012 1112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:10.071393 1113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2afb5413a1a64afda69760b6e02373b6. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } }
I20260807 22:38:10.071550 1113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:10.072146 1121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:10.073001 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:10.058811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35788 (local address 127.26.52.126:46847)
0807 22:38:10.059254 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:10.059290 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:10.059337 (+ 47us) server_negotiation.cc:407] Connection header received
0807 22:38:10.059956 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:10.059972 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:10.060384 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:10.060742 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:10.061566 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.062578 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.063426 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.063897 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.064066 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:10.066773 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:10.066779 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:10.066791 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:10.066818 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:10.068867 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:10.069430 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:10.069435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:10.069439 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:10.069547 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:10.069887 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:10.069891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:10.069894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:10.070401 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:10.071308 (+ 907us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:10.071473 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 22:38:10.071780 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":139,"threads_started":1}
I20260807 22:38:10.074899 1121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:10.081992 1121 catalog_manager.cc:1347] Generated new cluster ID: 77ea2c8a9ae943c79a86d4191877a8a5
I20260807 22:38:10.082072 1121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:10.092512 1121 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:10.093727 1121 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:10.109683 1121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6: Generated new TSK 0
I20260807 22:38:10.110442 1121 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab.
Entry for principal oryx/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab.
I20260807 22:38:10.146705 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46847
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab
--principal=oryx/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:10.287101 1134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:10.287360 1134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:10.287403 1134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:10.291364 1134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:10.291447 1134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:10.291533 1134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:10.296655 1134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab
--principal=oryx/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:10.297675 1134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:10.298681 1134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:10.308310 1139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:10.308310 1140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:10.308313 1143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:10.308495 1134 server_base.cc:1034] running on GCE node
I20260807 22:38:10.309028 1134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:10.309613 1134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:10.310765 1134 hybrid_clock.cc:648] HybridClock initialized: now 1786142290310732 us; error 44 us; skew 500 ppm
Aug 07 22:38:10 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142290, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:10.313532 1134 init.cc:377] Logged in from keytab as oryx/127.26.52.65@KRBTEST.COM (short username oryx)
I20260807 22:38:10.314443 1134 webserver.cc:460] Webserver started at http://127.26.52.65:34739/ using document root <none> and password file <none>
I20260807 22:38:10.315007 1134 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:10.315069 1134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:10.315307 1134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:10.317363 1134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "8f5ac8ca5209433e9c8780fd026d8eda"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "14481e637cfec8aa0ca7b9c6ec03b1ba"
server_key_iv: "afcfa26e359563d7aa75c592950de3da"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.317929 1134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "8f5ac8ca5209433e9c8780fd026d8eda"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "14481e637cfec8aa0ca7b9c6ec03b1ba"
server_key_iv: "afcfa26e359563d7aa75c592950de3da"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.321663 1134 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:38:10.323942 1150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:10.325276 1134 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:10.325399 1134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "8f5ac8ca5209433e9c8780fd026d8eda"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "14481e637cfec8aa0ca7b9c6ec03b1ba"
server_key_iv: "afcfa26e359563d7aa75c592950de3da"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.325500 1134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:10.341747 1134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:10.345006 1134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:10.345247 1134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:10.345852 1134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:10.346691 1134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:10.346740 1134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:10.346807 1134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:10.346838 1134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:10.355589 1134 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:39423
I20260807 22:38:10.355615 1272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:39423 every 8 connection(s)
I20260807 22:38:10.356539 1134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:10.364899 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 1134
I20260807 22:38:10.365061 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:38:10.365398 26833 external_mini_cluster.cc:1428] Setting key 3e62344956d4e280268d93ecc6299b90
Aug 07 22:38:10 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142290, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:10.370952 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:10.358328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:34259 (local address 127.26.52.126:46847)
0807 22:38:10.358473 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:10.358477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:10.359250 (+ 773us) server_negotiation.cc:407] Connection header received
0807 22:38:10.360685 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:10.360689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:10.360747 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:10.360851 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:10.362007 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.362523 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.363633 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.363873 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.364000 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:10.366752 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:10.366759 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:10.366766 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:10.366799 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:10.368310 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:10.369113 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:10.369119 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:10.369122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:10.369224 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:10.369593 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:10.369599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:10.369602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:10.369889 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:10.370007 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:10.370614 (+ 607us) server_negotiation.cc:299] Negotiation successful
0807 22:38:10.370738 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:38:10.372061 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:10.358671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.65:34259)
0807 22:38:10.359098 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:10.359139 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:10.360477 (+ 1338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:10.361020 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:10.361026 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:10.361371 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:10.361828 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:10.361841 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.362649 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.362652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:10.363499 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:10.363509 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.364039 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.364043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:10.364234 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:10.364783 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:10.364804 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:10.366559 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:10.368455 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:10.368464 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:10.368482 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:10.368865 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:10.369338 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:10.369341 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:10.369342 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:10.369505 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:10.370013 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:10.370018 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:10.370259 (+ 241us) client_negotiation.cc:769] Sending connection context
0807 22:38:10.370509 (+ 250us) client_negotiation.cc:240] Negotiation successful
0807 22:38:10.370924 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":104,"threads_started":1}
I20260807 22:38:10.373471 1273 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46847
I20260807 22:38:10.373756 1273 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:10.374262 1273 heartbeater.cc:511] Master 127.26.52.126:46847 requested a full tablet report, sending...
I20260807 22:38:10.375799 1067 ts_manager.cc:194] Registered new tserver with Master: 8f5ac8ca5209433e9c8780fd026d8eda (127.26.52.65:39423)
WARNING: no policy specified for oryx/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:38:10.377084 1067 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:34259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab.
Entry for principal oryx/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab.
I20260807 22:38:10.395910 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46847
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab
--principal=oryx/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:10.509581 1279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:10.509828 1279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:10.509869 1279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:10.513900 1279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:10.513955 1279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:10.514011 1279 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:10.519284 1279 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab
--principal=oryx/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:10.520321 1279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:10.521433 1279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:10.531170 1284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:10.531167 1287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:10.531200 1285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:10.531502 1279 server_base.cc:1034] running on GCE node
I20260807 22:38:10.531960 1279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:10.532625 1279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:10.533819 1279 hybrid_clock.cc:648] HybridClock initialized: now 1786142290533781 us; error 47 us; skew 500 ppm
Aug 07 22:38:10 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142290, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:10.536499 1279 init.cc:377] Logged in from keytab as oryx/127.26.52.66@KRBTEST.COM (short username oryx)
I20260807 22:38:10.537271 1279 webserver.cc:460] Webserver started at http://127.26.52.66:35125/ using document root <none> and password file <none>
I20260807 22:38:10.537796 1279 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:10.537853 1279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:10.538013 1279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:10.539981 1279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "713b38abfd6046dfba31aca74ea188d3"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "9a5f9c1284d3cfe489da7de5dbcca794"
server_key_iv: "1376c20308ae8fc56201429110c5837c"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.540555 1279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "713b38abfd6046dfba31aca74ea188d3"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "9a5f9c1284d3cfe489da7de5dbcca794"
server_key_iv: "1376c20308ae8fc56201429110c5837c"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.544335 1279 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:38:10.546693 1296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:10.547873 1279 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:10.547994 1279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "713b38abfd6046dfba31aca74ea188d3"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "9a5f9c1284d3cfe489da7de5dbcca794"
server_key_iv: "1376c20308ae8fc56201429110c5837c"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.548099 1279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:10.573414 1279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:10.576851 1279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:10.577062 1279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:10.577684 1279 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:10.578534 1279 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:10.578591 1279 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:10.578696 1279 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:10.578737 1279 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:10.587625 1279 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:40305
I20260807 22:38:10.587652 1416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:40305 every 8 connection(s)
I20260807 22:38:10.588548 1279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:10.592541 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 1279
I20260807 22:38:10.592689 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:38:10.593016 26833 external_mini_cluster.cc:1428] Setting key b075b638aef9e5cea3f057cff1e68dbe
Aug 07 22:38:10 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142290, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:10.602051 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:10.590335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:39601 (local address 127.26.52.126:46847)
0807 22:38:10.590474 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:10.590478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:10.591311 (+ 833us) server_negotiation.cc:407] Connection header received
0807 22:38:10.592744 (+ 1433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:10.592748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:10.592808 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:10.592916 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:10.594200 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.594711 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.595811 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.596043 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.596171 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:10.598544 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:10.598553 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:10.598556 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:10.598579 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:10.600019 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:10.600558 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:10.600566 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:10.600568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:10.600641 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:10.600989 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:10.600992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:10.600994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:10.601168 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:10.601275 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:10.601749 (+ 474us) server_negotiation.cc:299] Negotiation successful
0807 22:38:10.601868 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
WARNING: no policy specified for oryx/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:38:10.602846 1419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:10.590728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.66:39601)
0807 22:38:10.591166 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:10.591206 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:10.592522 (+ 1316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:10.593106 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:10.593118 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:10.593578 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:10.594054 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:10.594068 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.594833 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.594837 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:10.595679 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:10.595689 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.596231 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.596236 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:10.596398 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:10.596977 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:10.596992 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:10.598377 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:10.600170 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:10.600176 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:10.600189 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:10.600445 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:10.600741 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:10.600744 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:10.600746 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:10.600880 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:10.601274 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:10.601280 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:10.601516 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 22:38:10.601692 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 22:38:10.601998 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":116,"threads_started":1}
I20260807 22:38:10.603971 1417 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46847
I20260807 22:38:10.604269 1417 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:10.604750 1417 heartbeater.cc:511] Master 127.26.52.126:46847 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.67@KRBTEST.COM" created.
I20260807 22:38:10.605835 1067 ts_manager.cc:194] Registered new tserver with Master: 713b38abfd6046dfba31aca74ea188d3 (127.26.52.66:40305)
I20260807 22:38:10.606405 1067 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:39601
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab.
Entry for principal oryx/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab.
I20260807 22:38:10.620695 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46847
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab
--principal=oryx/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:10.732441 1422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:10.732662 1422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:10.732703 1422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:10.736773 1422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:10.736824 1422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:10.736879 1422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:10.741897 1422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab
--principal=oryx/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:10.742813 1422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:10.743727 1422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:10.753341 1431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:10.753412 1428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:10.753562 1422 server_base.cc:1034] running on GCE node
W20260807 22:38:10.753564 1427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:10.754110 1422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:10.754714 1422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:10.755873 1422 hybrid_clock.cc:648] HybridClock initialized: now 1786142290755862 us; error 41 us; skew 500 ppm
Aug 07 22:38:10 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142290, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:10.758518 1422 init.cc:377] Logged in from keytab as oryx/127.26.52.67@KRBTEST.COM (short username oryx)
I20260807 22:38:10.759292 1422 webserver.cc:460] Webserver started at http://127.26.52.67:33411/ using document root <none> and password file <none>
I20260807 22:38:10.759811 1422 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:10.759868 1422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:10.760031 1422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:10.762029 1422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "80d3e6bbfc44402e87ba81c494fb2508"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "f43496fd92f72e07a327ed0d9edbf2e6"
server_key_iv: "f5f3d55822274b0621a79727466da0e7"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.762540 1422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "80d3e6bbfc44402e87ba81c494fb2508"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "f43496fd92f72e07a327ed0d9edbf2e6"
server_key_iv: "f5f3d55822274b0621a79727466da0e7"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.766151 1422 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:38:10.768527 1439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:10.769757 1422 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:10.769884 1422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "80d3e6bbfc44402e87ba81c494fb2508"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "f43496fd92f72e07a327ed0d9edbf2e6"
server_key_iv: "f5f3d55822274b0621a79727466da0e7"
server_key_version: "encryptionkey@0"
I20260807 22:38:10.769994 1422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:10.802273 1422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:10.805750 1422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:10.805912 1422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:10.806461 1422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:10.807253 1422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:10.807301 1422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:10.807343 1422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:10.807364 1422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:10.816643 1422 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:36127
I20260807 22:38:10.816672 1558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:36127 every 8 connection(s)
I20260807 22:38:10.817631 1422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:38:10 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142290, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:10.827430 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 1422
I20260807 22:38:10.827586 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:38:10.827894 26833 external_mini_cluster.cc:1428] Setting key de1ebcd7b8dd042d890dc727b4f1d8cc
I20260807 22:38:10.831458 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:10.819504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:39757 (local address 127.26.52.126:46847)
0807 22:38:10.819649 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:10.819653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:10.820544 (+ 891us) server_negotiation.cc:407] Connection header received
0807 22:38:10.822061 (+ 1517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:10.822064 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:10.822114 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:10.822190 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:10.823386 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.823905 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.825061 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.825265 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.825344 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:10.827727 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:10.827736 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:10.827738 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:10.827762 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:10.829502 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:10.830016 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:10.830020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:10.830023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:10.830122 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:10.830506 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:10.830509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:10.830510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:10.830679 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:10.830756 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:10.831231 (+ 475us) server_negotiation.cc:299] Negotiation successful
0807 22:38:10.831327 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:38:10.832403 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:10.819882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.67:39757)
0807 22:38:10.820393 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:10.820437 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:10.821850 (+ 1413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:10.822354 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:10.822361 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:10.822718 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:10.823252 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:10.823266 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.824019 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.824022 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:10.824953 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:10.824963 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:10.825398 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:10.825401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:10.825541 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:10.826074 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:10.826090 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:10.827529 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:10.829620 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:10.829626 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:10.829641 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:10.829904 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:10.830246 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:10.830251 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:10.830256 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:10.830414 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:10.830771 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:10.830777 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:10.831013 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 22:38:10.831176 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 22:38:10.831425 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":114,"threads_started":1}
I20260807 22:38:10.833526 1559 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46847
I20260807 22:38:10.833768 1559 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:10.834250 1559 heartbeater.cc:511] Master 127.26.52.126:46847 requested a full tablet report, sending...
I20260807 22:38:10.835261 1067 ts_manager.cc:194] Registered new tserver with Master: 80d3e6bbfc44402e87ba81c494fb2508 (127.26.52.67:36127)
I20260807 22:38:10.835775 1067 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:39757
I20260807 22:38:10.841850 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.52.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.125.keytab.
Entry for principal oryx/127.26.52.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.125.keytab.
I20260807 22:38:10.869385 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.125:40057
--webserver_interface=127.26.52.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.125.keytab
--principal=oryx/127.26.52.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:46847,127.26.52.125:40057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:10.981573 1565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:10.981849 1565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:10.981922 1565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:10.986379 1565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:10.986490 1565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:10.986534 1565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:10.986593 1565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:10.986634 1565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:10.992064 1565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:46847,127.26.52.125:40057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.125.keytab
--principal=oryx/127.26.52.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.125:40057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.52.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
W20260807 22:38:10.992344 1565 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.52.126:46847,127.26.52.125:40057'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 22:38:10.993278 1565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:10.994269 1565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:11.002663 1571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:11.002691 1573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:11.002668 1570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:11.002874 1565 server_base.cc:1034] running on GCE node
I20260807 22:38:11.003607 1565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:11.004752 1565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:11.005950 1565 hybrid_clock.cc:648] HybridClock initialized: now 1786142291005936 us; error 25 us; skew 500 ppm
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:11.008689 1565 init.cc:377] Logged in from keytab as oryx/127.26.52.125@KRBTEST.COM (short username oryx)
I20260807 22:38:11.009564 1565 webserver.cc:460] Webserver started at http://127.26.52.125:39303/ using document root <none> and password file <none>
I20260807 22:38:11.010136 1565 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:11.010226 1565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:11.010476 1565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:11.012581 1565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data/instance:
uuid: "0813591a252644dab7d6a557c9557f15"
format_stamp: "Formatted at 2026-08-07 22:38:11 on dist-test-slave-8w9v"
server_key: "8c493ab7cc1f69e9666fcb0164dd2c03"
server_key_iv: "7ca7f062abe9f2a0921340aa2e217248"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.013134 1565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal/instance:
uuid: "0813591a252644dab7d6a557c9557f15"
format_stamp: "Formatted at 2026-08-07 22:38:11 on dist-test-slave-8w9v"
server_key: "8c493ab7cc1f69e9666fcb0164dd2c03"
server_key_iv: "7ca7f062abe9f2a0921340aa2e217248"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.017017 1565 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:38:11.019435 1582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.020666 1565 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:38:11.020813 1565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal
uuid: "0813591a252644dab7d6a557c9557f15"
format_stamp: "Formatted at 2026-08-07 22:38:11 on dist-test-slave-8w9v"
server_key: "8c493ab7cc1f69e9666fcb0164dd2c03"
server_key_iv: "7ca7f062abe9f2a0921340aa2e217248"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.020920 1565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:11.035141 1565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:11.038069 1565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:11.038278 1565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:11.045094 1565 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.125:40057
I20260807 22:38:11.045372 1634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.125:40057 every 8 connection(s)
I20260807 22:38:11.046111 1565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
I20260807 22:38:11.049268 1635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:11.053690 1635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:38:11.056368 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 1565
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.125@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.52.125@KRBTEST.COM
I20260807 22:38:11.068616 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.055634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35790 (local address 127.26.52.126:46847)
0807 22:38:11.055779 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.055784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.056795 (+ 1011us) server_negotiation.cc:407] Connection header received
0807 22:38:11.057908 (+ 1113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.057912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.057964 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.058049 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.059117 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.059654 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.061136 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.061525 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.061626 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.064635 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.064639 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.064641 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.064667 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.066419 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.066958 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.066965 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.066967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.067063 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.067429 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.067433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.067435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.067722 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.067807 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.068331 (+ 524us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.068460 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:38:11.069458 1640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.057216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37580 (local address 127.26.52.125:40057)
0807 22:38:11.057681 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.057695 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.057746 (+ 51us) server_negotiation.cc:407] Connection header received
0807 22:38:11.057912 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.057917 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.058128 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.058315 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.059133 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.060478 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.061666 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.062080 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.062164 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.065037 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.065050 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.065059 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.065079 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.066653 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.067157 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.067163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.067164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.067313 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.067625 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.067627 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.067628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.068026 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.068247 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.068812 (+ 565us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.068946 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":107,"server-negotiator.queue_time_us":359,"spinlock_wait_cycles":13440,"thread_start_us":143,"threads_started":1}
I20260807 22:38:11.069458 1638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.056026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:35790)
0807 22:38:11.056654 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.056704 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.057683 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.058130 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.058138 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.058552 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.058961 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.058978 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.059793 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.059796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.060962 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.060975 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.061798 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.061802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.061982 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.062589 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.062633 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.064453 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.066546 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.066556 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.066567 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.066838 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.067157 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.067160 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.067162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.067313 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.067825 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.067830 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.068028 (+ 198us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.068225 (+ 197us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.068497 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":179,"spinlock_wait_cycles":6144,"thread_start_us":174,"threads_started":1}
I20260807 22:38:11.070950 1635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.125@KRBTEST.COM for oryx/127.26.52.125@KRBTEST.COM
I20260807 22:38:11.082366 1640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.071524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37596 (local address 127.26.52.125:40057)
0807 22:38:11.071611 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.071618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.071631 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:38:11.071739 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.071742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.071776 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.071851 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.074524 (+ 2673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.075003 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.076383 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.076692 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.076810 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.079162 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.079165 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.079168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.079191 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.080784 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.081180 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.081186 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.081188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.081258 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.081529 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.081534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.081536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.081709 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.081814 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.082081 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.082231 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":33}
I20260807 22:38:11.082366 1638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.071479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40057 (local address 127.0.0.1:37596)
0807 22:38:11.071580 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.071594 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.071667 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.071867 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.071869 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.071995 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.072081 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.072085 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.075595 (+ 3510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.075598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.076242 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.076252 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.076810 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.076813 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.076917 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.077467 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.077480 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.078956 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.080889 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.080895 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.080898 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.081086 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.081349 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.081353 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.081355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.081440 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.081804 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.081806 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.081885 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.082033 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.082176 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 22:38:11.085539 1635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Bootstrap starting.
I20260807 22:38:11.087873 1635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:11.088665 1635 log.cc:824] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:11.090610 1635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: No bootstrap required, opened a new log
I20260807 22:38:11.093631 1635 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } }
I20260807 22:38:11.093825 1635 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:11.093912 1635 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0813591a252644dab7d6a557c9557f15, State: Initialized, Role: FOLLOWER
I20260807 22:38:11.094317 1635 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } }
I20260807 22:38:11.094843 1642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } } }
I20260807 22:38:11.094978 1642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:38:11.095489 1635 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 22:38:11.100243 1653 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:38:11.100324 1653 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:38:11.102463 1565 master_runner.cc:428] Detected that this master 0813591a252644dab7d6a557c9557f15 is joining an existing cluster
I20260807 22:38:11.102530 1565 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.52.125:40057
I20260807 22:38:11.113101 1640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.104625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37608 (local address 127.26.52.125:40057)
0807 22:38:11.104844 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.104848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.105061 (+ 213us) server_negotiation.cc:407] Connection header received
0807 22:38:11.105186 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.105191 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.105229 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.105319 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.105754 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.106324 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.107515 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.107852 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.107960 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.109685 (+ 1725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.109689 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.109692 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.109711 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.111432 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.111889 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.111894 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.111896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.111982 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.112294 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.112297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.112299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.112465 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.112564 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.112817 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.112971 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":150}
I20260807 22:38:11.113117 1660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.104715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40057 (local address 127.0.0.1:37608)
0807 22:38:11.104977 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.104988 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.105100 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.105333 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.105336 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.105551 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.105646 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.105652 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.106446 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.106451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.107378 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.107389 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.108106 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.108109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.108288 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.109058 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.109076 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.109554 (+ 478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.111559 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.111563 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.111565 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.111794 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.112074 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.112077 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.112079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.112190 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.112564 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.112567 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.112666 (+ 99us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.112774 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.112914 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":89,"spinlock_wait_cycles":3840,"thread_start_us":95,"threads_started":1}
I20260807 22:38:11.113409 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.104615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35796 (local address 127.26.52.126:46847)
0807 22:38:11.104749 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.104754 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.104994 (+ 240us) server_negotiation.cc:407] Connection header received
0807 22:38:11.105175 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.105178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.105231 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.105284 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.106182 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.106782 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.107635 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.107982 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.108093 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.109705 (+ 1612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.109709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.109712 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.109741 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.111449 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.112003 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.112007 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.112008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.112094 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.112442 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.112446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.112448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.112657 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.112728 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.113127 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.113259 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:38:11.114023 1659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.104542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:35796)
0807 22:38:11.104915 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.104929 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.105065 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.105671 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.105674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.105904 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.106050 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.106058 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.106889 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.106895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.107514 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.107522 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.108106 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.108110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.108351 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.108943 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.108960 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.109554 (+ 594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.111576 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.111580 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.111582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.111888 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.112245 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.112248 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.112250 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.112332 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.112801 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.112804 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.112922 (+ 118us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.113710 (+ 788us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.113846 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":65,"spinlock_wait_cycles":11776,"thread_start_us":96,"threads_started":1}
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142289, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.126@KRBTEST.COM for oryx/127.26.52.125@KRBTEST.COM
I20260807 22:38:11.128733 1640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.118352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37620 (local address 127.26.52.125:40057)
0807 22:38:11.118468 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.118472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.118754 (+ 282us) server_negotiation.cc:407] Connection header received
0807 22:38:11.118950 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.118953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.119005 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.119086 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.119662 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.120163 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.121009 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.121239 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.121347 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.124009 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.124012 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.124015 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.124060 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.126629 (+ 2569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.127203 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.127207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.127208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.127289 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.127633 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.127636 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.127637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.127831 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.127925 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.128410 (+ 485us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.128524 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:38:11.128826 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.118314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40057 (local address 127.0.0.1:37620)
0807 22:38:11.118640 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.118679 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.118824 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.119120 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.119126 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.119452 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.119549 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.119555 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.120270 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.120274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.120866 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.120874 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.121350 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.121354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.121470 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.122027 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.122043 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.123824 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.126764 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.126774 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.126780 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.127083 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.127400 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.127405 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.127408 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.127527 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.127953 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.127963 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.128108 (+ 145us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.128355 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.128641 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":102,"threads_started":1}
I20260807 22:38:11.130270 1067 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.52.125:40057: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "0813591a252644dab7d6a557c9557f15"
member_type: NON_VOTER
last_known_addr {
host: "127.26.52.125"
port: 40057
}
attrs {
promote: true
}
}
dest_uuid: "2afb5413a1a64afda69760b6e02373b6"
cas_config_opid_index: -1
I20260807 22:38:11.130939 1067 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } }
I20260807 22:38:11.132967 1665 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 0813591a252644dab7d6a557c9557f15 (127.26.52.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } } }
I20260807 22:38:11.133248 1609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:11.134356 1665 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.52.125:40057
I20260807 22:38:11.134562 1664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } } }
I20260807 22:38:11.134656 1664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:11.134644 1609 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Refusing update from remote peer 2afb5413a1a64afda69760b6e02373b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 22:38:11.135296 1565 master.cc:537] Master@127.26.52.125:40057 shutting down...
I20260807 22:38:11.135358 1664 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 22:38:11.138206 1052 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260807 22:38:11.139061 1052 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 -> Peer 0813591a252644dab7d6a557c9557f15 (127.26.52.125:40057): Couldn't send request to peer 0813591a252644dab7d6a557c9557f15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 22:38:11.139809 1565 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:11.140072 1565 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:11.140213 1565 tablet_replica.cc:330] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: stopping tablet replica
WARNING: no policy specified for oryx/127.26.52.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.124@KRBTEST.COM" created.
I20260807 22:38:11.154544 1565 master.cc:552] Master@127.26.52.125:40057 shutdown complete.
I20260807 22:38:11.154608 1565 master_runner.cc:305] Clearing existing system tablet
I20260807 22:38:11.154865 1565 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:11.154918 1565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:11.156304 1565 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:11.157315 1671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.157611 1565 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:11.157747 1565 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:11.157783 1565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal
uuid: "0813591a252644dab7d6a557c9557f15"
format_stamp: "Formatted at 2026-08-07 22:38:11 on dist-test-slave-8w9v"
server_key: "8c493ab7cc1f69e9666fcb0164dd2c03"
server_key_iv: "7ca7f062abe9f2a0921340aa2e217248"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.160247 1565 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:11.163831 1565 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 22:38:11.163971 1565 log.cc:1196] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 22:38:11.164328 1565 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Deleting consensus metadata
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.124.keytab.
Entry for principal oryx/127.26.52.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.124.keytab.
I20260807 22:38:11.164551 1565 master_runner.cc:315] Copying system tablet from 127.26.52.126:46847
I20260807 22:38:11.165493 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.124:45551
--webserver_interface=127.26.52.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.124.keytab
--principal=oryx/127.26.52.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:46847,127.26.52.125:40057,127.26.52.124:45551
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:38:11.165916 1565 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: tablet copy: Beginning tablet copy session from remote peer at address 127.26.52.126:46847
I20260807 22:38:11.176479 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.168810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35802 (local address 127.26.52.126:46847)
0807 22:38:11.168967 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.168983 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.169261 (+ 278us) server_negotiation.cc:407] Connection header received
0807 22:38:11.169428 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.169432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.169488 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.169589 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.170055 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.170747 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.171692 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.171950 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.172062 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.173221 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.173225 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.173228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.173252 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.174835 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.175248 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.175251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.175253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.175336 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.175615 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.175619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.175621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.175801 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.175903 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.176196 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.176301 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:38:11.176496 1678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.168828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:35802)
0807 22:38:11.169144 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.169159 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.169309 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.169607 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.169609 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.169803 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.169928 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.169934 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.170884 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.170887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.171576 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.171586 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.172068 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.172072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.172182 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.172711 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.172722 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.173024 (+ 302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.174945 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.174948 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.174950 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.175147 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.175431 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.175433 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.175435 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.175524 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.175893 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.175895 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.176004 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.176111 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.176303 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":174,"threads_started":1}
I20260807 22:38:11.177660 1087 tablet_copy_service.cc:140] P 2afb5413a1a64afda69760b6e02373b6: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 0813591a252644dab7d6a557c9557f15 ({username='oryx', principal='oryx/127.26.52.125@KRBTEST.COM'} at 127.0.0.1:35802)
I20260807 22:38:11.177852 1087 tablet_copy_service.cc:161] P 2afb5413a1a64afda69760b6e02373b6: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 0813591a252644dab7d6a557c9557f15 at {username='oryx', principal='oryx/127.26.52.125@KRBTEST.COM'} at 127.0.0.1:35802: session id = 0813591a252644dab7d6a557c9557f15-00000000000000000000000000000000
I20260807 22:38:11.179425 1087 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 22:38:11.181053 1565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 22:38:11.183059 1565 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: tablet copy: Starting download of 0 data blocks...
I20260807 22:38:11.183266 1565 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: tablet copy: Starting download of 1 WAL segments...
I20260807 22:38:11.185025 1565 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 22:38:11.186591 1087 tablet_copy_service.cc:342] P 2afb5413a1a64afda69760b6e02373b6: Request end of tablet copy session 0813591a252644dab7d6a557c9557f15-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.52.125@KRBTEST.COM'} at 127.0.0.1:35802
I20260807 22:38:11.186709 1087 tablet_copy_service.cc:433] P 2afb5413a1a64afda69760b6e02373b6: ending tablet copy session 0813591a252644dab7d6a557c9557f15-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 0813591a252644dab7d6a557c9557f15
I20260807 22:38:11.193073 1565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:11.194650 1679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:11.194749 1682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:11.195362 1565 server_base.cc:1034] running on GCE node
W20260807 22:38:11.195488 1680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:11.195744 1565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:11.196095 1565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:11.197263 1565 hybrid_clock.cc:648] HybridClock initialized: now 1786142291197245 us; error 33 us; skew 500 ppm
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:11.198735 1565 init.cc:377] Logged in from keytab as oryx/127.26.52.125@KRBTEST.COM (short username oryx)
I20260807 22:38:11.199234 1565 webserver.cc:460] Webserver started at http://127.26.52.125:40347/ using document root <none> and password file <none>
I20260807 22:38:11.199396 1565 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:11.199422 1565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:11.200596 1565 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:11.201573 1689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.201814 1565 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:11.201895 1565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal
uuid: "0813591a252644dab7d6a557c9557f15"
format_stamp: "Formatted at 2026-08-07 22:38:11 on dist-test-slave-8w9v"
server_key: "8c493ab7cc1f69e9666fcb0164dd2c03"
server_key_iv: "7ca7f062abe9f2a0921340aa2e217248"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.201987 1565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:11.231038 1565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:11.233251 1565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:11.237385 1565 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.125:40057
I20260807 22:38:11.237444 1745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.125:40057 every 8 connection(s)
I20260807 22:38:11.238106 1565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
I20260807 22:38:11.239610 1746 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:38:11.240494 1746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Bootstrap starting.
I20260807 22:38:11.249717 1746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:38:11.250084 1746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Bootstrap complete.
I20260807 22:38:11.250660 1746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } }
I20260807 22:38:11.250810 1746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0813591a252644dab7d6a557c9557f15, State: Initialized, Role: LEARNER
I20260807 22:38:11.250965 1746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } }
I20260807 22:38:11.251384 1749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } } }
I20260807 22:38:11.251569 1749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: This master's current role is: LEARNER
I20260807 22:38:11.251606 1746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:11.256670 1761 catalog_manager.cc:1259] Loaded cluster ID: 77ea2c8a9ae943c79a86d4191877a8a5
I20260807 22:38:11.256762 1761 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: loading cluster ID for follower catalog manager: success
I20260807 22:38:11.258436 1761 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: acquiring CA information for follower catalog manager: success
I20260807 22:38:11.259630 1761 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 22:38:11.317584 1677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:11.317878 1677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:11.317919 1677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:11.321903 1677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:11.321956 1677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:11.321975 1677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:11.321991 1677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:11.322006 1677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:11.327101 1677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:46847,127.26.52.125:40057,127.26.52.124:45551
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.124.keytab
--principal=oryx/127.26.52.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.124:45551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.52.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:11.328091 1677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:11.329177 1677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:11.337702 1766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:11.337798 1677 server_base.cc:1034] running on GCE node
W20260807 22:38:11.337702 1769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:11.337720 1767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:11.338575 1677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:11.339697 1677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:11.340884 1677 hybrid_clock.cc:648] HybridClock initialized: now 1786142291340876 us; error 29 us; skew 500 ppm
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:11.343547 1677 init.cc:377] Logged in from keytab as oryx/127.26.52.124@KRBTEST.COM (short username oryx)
I20260807 22:38:11.344496 1677 webserver.cc:460] Webserver started at http://127.26.52.124:44249/ using document root <none> and password file <none>
I20260807 22:38:11.345048 1677 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:11.345136 1677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:11.345377 1677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:11.347339 1677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data/instance:
uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec"
format_stamp: "Formatted at 2026-08-07 22:38:11 on dist-test-slave-8w9v"
server_key: "a976c4592a293ed7770236e1ff5974c5"
server_key_iv: "76124ae8050ef00d72644f9d5338bacb"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.347898 1677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal/instance:
uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec"
format_stamp: "Formatted at 2026-08-07 22:38:11 on dist-test-slave-8w9v"
server_key: "a976c4592a293ed7770236e1ff5974c5"
server_key_iv: "76124ae8050ef00d72644f9d5338bacb"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.351572 1677 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:38:11.353948 1776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.355154 1677 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:11.355306 1677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal
uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec"
format_stamp: "Formatted at 2026-08-07 22:38:11 on dist-test-slave-8w9v"
server_key: "a976c4592a293ed7770236e1ff5974c5"
server_key_iv: "76124ae8050ef00d72644f9d5338bacb"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.355412 1677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:11.367887 1677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:11.370641 1677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:11.370832 1677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:11.379429 1273 heartbeater.cc:503] Master 127.26.52.126:46847 was elected leader, sending a full tablet report...
I20260807 22:38:11.380405 1677 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.124:45551
I20260807 22:38:11.380769 1834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.124:45551 every 8 connection(s)
I20260807 22:38:11.381466 1677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
I20260807 22:38:11.384368 1835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:11.384850 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 1677
I20260807 22:38:11.389549 1835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.52.124@KRBTEST.COM
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.124@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:11.399822 1837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.386321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37722 (local address 127.26.52.124:45551)
0807 22:38:11.386752 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.386767 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.386800 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:38:11.387652 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.387688 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.387991 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.388463 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.389254 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.390278 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.391167 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.391772 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.391955 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.394728 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.394735 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.394746 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.394778 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.396484 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.396907 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.396922 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.396929 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.397095 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.397369 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.397373 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.397375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.397876 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.398183 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.398404 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.398689 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":131,"threads_started":1}
I20260807 22:38:11.400594 1838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.391030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:35806)
0807 22:38:11.391384 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.391440 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.391568 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.391855 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.391861 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.392342 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.392523 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.392534 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.393288 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.393291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.394243 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.394256 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.394721 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.394725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.394832 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.395417 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.395430 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.396912 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.398802 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.398809 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.398814 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.399027 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.399324 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.399327 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.399328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.399442 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.399918 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.399924 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.400062 (+ 138us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.400259 (+ 197us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.400394 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":106,"threads_started":1}
I20260807 22:38:11.400600 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.391253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35806 (local address 127.26.52.126:46847)
0807 22:38:11.391367 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.391372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.391516 (+ 144us) server_negotiation.cc:407] Connection header received
0807 22:38:11.391672 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.391682 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.391723 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.391807 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.392663 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.393162 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.394348 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.394566 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.394671 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.397099 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.397103 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.397105 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.397135 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.398696 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.399123 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.399126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.399128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.399218 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.399524 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.399527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.399529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.399756 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.399904 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.400340 (+ 436us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.400457 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:38:11.402035 1835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.124@KRBTEST.COM for oryx/127.26.52.125@KRBTEST.COM
I20260807 22:38:11.409902 1838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.402562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40057 (local address 127.0.0.1:37632)
0807 22:38:11.402694 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.402706 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.402765 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.403111 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.403113 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.403233 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.403508 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.403517 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.404471 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.404473 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.404970 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.404978 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.405383 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.405386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.405516 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.405891 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.405901 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.407108 (+ 1207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.408774 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.408776 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.408777 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.408947 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.409176 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.409178 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.409180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.409246 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.409562 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.409564 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.409631 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.409707 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.409798 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 22:38:11.409966 1839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.402608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37632 (local address 127.26.52.125:40057)
0807 22:38:11.402913 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.402918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.402932 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:38:11.402972 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.402974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.403012 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.403086 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.403631 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.404368 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.405067 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.405295 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.405367 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.407231 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.407234 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.407236 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.407257 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.408686 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.409028 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.409031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.409032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.409099 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.409318 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.409320 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.409321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.409485 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.409557 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.409761 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.409849 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":141,"threads_started":1}
I20260807 22:38:11.410861 1835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.124@KRBTEST.COM for oryx/127.26.52.124@KRBTEST.COM
I20260807 22:38:11.418905 1837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.411499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37734 (local address 127.26.52.124:45551)
0807 22:38:11.411613 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.411617 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.411627 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:38:11.411653 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.411656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.411692 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.411771 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.412081 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.413036 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.413801 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.414143 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.414255 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.416158 (+ 1903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.416164 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.416167 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.416188 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.417422 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.417802 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.417808 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.417809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.417900 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.418168 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.418171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.418173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.418324 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.418427 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.418654 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.418789 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":75,"server-negotiator.queue_time_us":46}
I20260807 22:38:11.418905 1838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.411320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.0.0.1:37734)
0807 22:38:11.411447 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.411458 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.411514 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.411781 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.411784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.411925 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.411979 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.411983 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.413202 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.413208 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.413691 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.413698 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.414253 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.414257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.414379 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.414827 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.414839 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.416004 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.417523 (+ 1519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.417529 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.417532 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.417711 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.417995 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.417999 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.418001 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.418077 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.418425 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.418427 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.418509 (+ 82us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.418611 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.418737 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":24}
I20260807 22:38:11.422247 1835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: Bootstrap starting.
I20260807 22:38:11.425004 1835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:11.426138 1835 log.cc:824] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:11.428248 1835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: No bootstrap required, opened a new log
I20260807 22:38:11.432723 1835 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } }
I20260807 22:38:11.432991 1835 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:11.433075 1835 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b69fc9fd5743d1a02246bfa6d5f7ec, State: Initialized, Role: FOLLOWER
I20260807 22:38:11.433626 1835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } }
I20260807 22:38:11.434605 1841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } } }
I20260807 22:38:11.434842 1841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:38:11.435395 1835 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: configured and running, proceeding with master startup.
W20260807 22:38:11.442149 1852 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:38:11.442231 1852 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:38:11.443711 1841 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:11.443938 1841 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } }
I20260807 22:38:11.445091 1841 leader_election.cc:288] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847), 0813591a252644dab7d6a557c9557f15 (127.26.52.125:40057)
I20260807 22:38:11.445641 1077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afb5413a1a64afda69760b6e02373b6" is_pre_election: true
I20260807 22:38:11.446293 1677 master_runner.cc:428] Detected that this master 52b69fc9fd5743d1a02246bfa6d5f7ec is joining an existing cluster
I20260807 22:38:11.446369 1677 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.52.124:45551
I20260807 22:38:11.447033 1717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0813591a252644dab7d6a557c9557f15" is_pre_election: true
I20260807 22:38:11.447237 1717 raft_consensus.cc:1799] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 LEARNER]: Handling vote request from an unknown peer 52b69fc9fd5743d1a02246bfa6d5f7ec
I20260807 22:38:11.447425 1717 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate 52b69fc9fd5743d1a02246bfa6d5f7ec for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 22:38:11.448364 1781 leader_election.cc:302] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52b69fc9fd5743d1a02246bfa6d5f7ec; no voters: 0813591a252644dab7d6a557c9557f15, 2afb5413a1a64afda69760b6e02373b6
I20260807 22:38:11.448802 1841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:11.450620 1841 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 22:38:11.454259 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 1134
I20260807 22:38:11.462841 1839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.451773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37634 (local address 127.26.52.125:40057)
0807 22:38:11.451891 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.451895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.453431 (+ 1536us) server_negotiation.cc:407] Connection header received
0807 22:38:11.453622 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.453626 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.453679 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.453798 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.454919 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.455507 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.456780 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.457061 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.457131 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.459129 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.459133 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.459136 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.459161 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.461034 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.461574 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.461577 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.461579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.461667 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.461952 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.461955 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.461957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.462137 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.462203 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.462554 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.462674 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:38:11.463662 1860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.451738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40057 (local address 127.0.0.1:37634)
0807 22:38:11.453304 (+ 1566us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.453322 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.453502 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.453971 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.453974 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.454468 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.454777 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.454787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.455642 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.455644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.456630 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.456641 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.457290 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.457294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.457446 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.458531 (+ 1085us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.458546 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.458975 (+ 429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.461169 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.461171 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.461173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.461465 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.461785 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.461788 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.461789 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.461862 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.462275 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.462277 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.462377 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.463276 (+ 899us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.463426 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1380,"thread_start_us":95,"threads_started":1}
I20260807 22:38:11.466378 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.451109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35812 (local address 127.26.52.126:46847)
0807 22:38:11.451233 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.451238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.451544 (+ 306us) server_negotiation.cc:407] Connection header received
0807 22:38:11.451781 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.451785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.451840 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.451894 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.454400 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.455439 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.459182 (+ 3743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.459679 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.459786 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.461931 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.461938 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.461945 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.461984 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.464064 (+ 2080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.464731 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.464735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.464737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.464842 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.465240 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.465255 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.465257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.465550 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.465669 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.466042 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.466170 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:38:11.466403 1859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.451032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:35812)
0807 22:38:11.451466 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.451481 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.451585 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.452081 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.452083 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.452428 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.454255 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.454267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.457656 (+ 3389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.457663 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.458853 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.458868 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.459999 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.460006 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.460249 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.460796 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.460818 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.461608 (+ 790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.464260 (+ 2652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.464266 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.464271 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.464574 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.464972 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.464978 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.464983 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.465089 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.465671 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.465677 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.465788 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.465896 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.466062 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":158,"threads_started":1}
I20260807 22:38:11.472895 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:39423
--local_ip_for_outbound_sockets=127.26.52.65
--tserver_master_addrs=127.26.52.126:46847
--webserver_port=34739
--webserver_interface=127.26.52.65
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab
--principal=oryx/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.52.126:46847,127.26.52.125:40057
--tserver_master_addrs=127.26.52.126:46847,127.26.52.125:40057,127.26.52.124:45551 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142289, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.126@KRBTEST.COM for oryx/127.26.52.124@KRBTEST.COM
I20260807 22:38:11.513443 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.471058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.0.0.1:37752)
0807 22:38:11.471218 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.471236 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.471344 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.472431 (+ 1087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.472434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.472638 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.472763 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.472772 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.474316 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.474320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.475198 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.475210 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.475782 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.475787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.475911 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.476468 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.476483 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.477707 (+ 1224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.510976 (+ 33269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.510981 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.510984 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.511307 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.511659 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.511663 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.511665 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.511771 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.512858 (+ 1087us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.512862 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.512982 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.513072 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.513242 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 22:38:11.514221 1862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.471688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37752 (local address 127.26.52.124:45551)
0807 22:38:11.472046 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.472082 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.472098 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:38:11.472220 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.472226 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.472292 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.472386 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.472902 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.474191 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.475318 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.475635 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.475717 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.477855 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.477859 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.477862 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.477893 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.510786 (+ 32893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.511452 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.511455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.511458 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.511547 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.511897 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.511900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.511902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.512740 (+ 838us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.513819 (+ 1079us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.513904 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.514034 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":119,"threads_started":1}
I20260807 22:38:11.515373 1067 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.52.124:45551: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec"
member_type: NON_VOTER
last_known_addr {
host: "127.26.52.124"
port: 45551
}
attrs {
promote: true
}
}
dest_uuid: "2afb5413a1a64afda69760b6e02373b6"
cas_config_opid_index: 5
I20260807 22:38:11.516072 1067 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } }
I20260807 22:38:11.516896 1861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.452429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.0.0.1:37748)
0807 22:38:11.453349 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.453365 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.453569 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.453857 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.453859 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.508518 (+ 54659us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.508722 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.508736 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.509891 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.509894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.510745 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.510760 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.511459 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.511462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.511543 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.512025 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.512040 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.512585 (+ 545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.515088 (+ 2503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.515091 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.515093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.515323 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.515716 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.515719 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.515720 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.515801 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.516394 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.516396 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.516484 (+ 88us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.516587 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.516713 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"thread_start_us":244,"threads_started":1}
I20260807 22:38:11.517505 1664 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.519138 1805 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Refusing update from remote peer 2afb5413a1a64afda69760b6e02373b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 22:38:11.519176 1664 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.52.124:45551
I20260807 22:38:11.519348 1664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.519433 1664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:11.519956 1677 master.cc:537] Master@127.26.52.124:45551 shutting down...
I20260807 22:38:11.520561 1837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.452422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37748 (local address 127.26.52.124:45551)
0807 22:38:11.452559 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.452563 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.453518 (+ 955us) server_negotiation.cc:407] Connection header received
0807 22:38:11.453656 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.453658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.453690 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.453733 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.508942 (+ 55209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.509729 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.510896 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.511230 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.511333 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.512741 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.512745 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.512747 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.512770 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.514725 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.515431 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.515435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.515437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.515510 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.515895 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.515898 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.515899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.516098 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.516267 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.520317 (+ 4050us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.520431 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:38:11.523061 1665 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 22:38:11.525595 1052 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 -> Peer 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124:45551): Couldn't send request to peer 52b69fc9fd5743d1a02246bfa6d5f7ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 22:38:11.526602 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.517471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40057 (local address 127.0.0.1:37644)
0807 22:38:11.517993 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.518008 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.518095 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.519487 (+ 1392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.519491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.519513 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:11.519610 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.519617 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.522984 (+ 3367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.522988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.524582 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.524594 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.525954 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.525958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.526112 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.526179 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.526296 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.526395 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445}
I20260807 22:38:11.526608 1839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.517766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37644 (local address 127.26.52.125:40057)
0807 22:38:11.517896 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.517901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.518181 (+ 280us) server_negotiation.cc:407] Connection header received
0807 22:38:11.518240 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.518244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.518312 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.518407 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:11.521835 (+ 3428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.522782 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.524759 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.525497 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.525611 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.525781 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.526368 (+ 587us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.526477 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:38:11.527503 1677 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:11.527629 1717 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 LEARNER]: Refusing update from remote peer 2afb5413a1a64afda69760b6e02373b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 22:38:11.527801 1677 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:11.527904 1677 tablet_replica.cc:330] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: stopping tablet replica
I20260807 22:38:11.528362 1665 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 22:38:11.530248 1717 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.532842 1749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2afb5413a1a64afda69760b6e02373b6. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.532897 1865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: NON_VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: true } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.532965 1749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: This master's current role is: LEARNER
I20260807 22:38:11.532979 1865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: This master's current role is: LEARNER
I20260807 22:38:11.533705 1665 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6: attempting to promote NON_VOTER 0813591a252644dab7d6a557c9557f15 to VOTER
I20260807 22:38:11.534173 1665 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } }
I20260807 22:38:11.535353 1861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.534535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.0.0.1:37758)
0807 22:38:11.535210 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.535281 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:45551: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490}
I20260807 22:38:11.535751 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.535132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.0.0.1:37762)
0807 22:38:11.535594 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.535665 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:45551: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364}
I20260807 22:38:11.535858 1717 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 LEARNER]: Refusing update from remote peer 2afb5413a1a64afda69760b6e02373b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 22:38:11.536808 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.536419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.0.0.1:37778)
0807 22:38:11.536665 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.536723 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:45551: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":97,"threads_started":1}
I20260807 22:38:11.536756 1866 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260807 22:38:11.537242 1052 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 -> Peer 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124:45551): Couldn't send request to peer 52b69fc9fd5743d1a02246bfa6d5f7ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.52.124:45551: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 22:38:11.538697 1664 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 0813591a252644dab7d6a557c9557f15 (127.26.52.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.539181 1717 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 0813591a252644dab7d6a557c9557f15 (127.26.52.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.540212 1664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.540339 1664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:11.540483 1664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.540563 1664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:11.541061 1865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.541172 1865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:38:11.544083 1677 master.cc:552] Master@127.26.52.124:45551 shutdown complete.
I20260807 22:38:11.544211 1677 master_runner.cc:305] Clearing existing system tablet
I20260807 22:38:11.544462 1677 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:11.544541 1677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:11.545604 1677 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:38:11.546489 1869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.546686 1677 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:11.546819 1677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:38:11.546855 1677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal
uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec"
format_stamp: "Formatted at 2026-08-07 22:38:11 on dist-test-slave-8w9v"
server_key: "a976c4592a293ed7770236e1ff5974c5"
server_key_iv: "76124ae8050ef00d72644f9d5338bacb"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.548781 1677 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:11.550601 1677 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 22:38:11.550690 1677 log.cc:1196] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 22:38:11.551153 1677 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: Deleting consensus metadata
I20260807 22:38:11.551409 1677 master_runner.cc:315] Copying system tablet from 127.26.52.126:46847
I20260807 22:38:11.552735 1677 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: tablet copy: Beginning tablet copy session from remote peer at address 127.26.52.126:46847
I20260807 22:38:11.561729 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.553327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35826 (local address 127.26.52.126:46847)
0807 22:38:11.553471 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.553477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.553702 (+ 225us) server_negotiation.cc:407] Connection header received
0807 22:38:11.553845 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.553848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.553903 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.553999 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.555475 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.556070 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.556940 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.557174 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.557286 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.558538 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.558542 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.558545 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.558569 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.560055 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.560550 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.560553 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.560555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.560636 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.560911 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.560922 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.560924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.561097 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.561207 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.561467 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.561573 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:38:11.561740 1875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.553292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:35826)
0807 22:38:11.553613 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.553626 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.553750 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.555058 (+ 1308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.555061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.555245 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.555343 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.555349 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.556232 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.556236 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.556804 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.556813 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.557292 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.557296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.557392 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.558061 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.558073 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.558384 (+ 311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.560225 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.560228 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.560230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.560442 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.560728 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.560732 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.560734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.560821 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.561196 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.561199 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.561302 (+ 103us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.561411 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.561566 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":87,"threads_started":1}
I20260807 22:38:11.562531 1087 tablet_copy_service.cc:140] P 2afb5413a1a64afda69760b6e02373b6: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 52b69fc9fd5743d1a02246bfa6d5f7ec ({username='oryx', principal='oryx/127.26.52.124@KRBTEST.COM'} at 127.0.0.1:35826)
I20260807 22:38:11.562637 1087 tablet_copy_service.cc:161] P 2afb5413a1a64afda69760b6e02373b6: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 52b69fc9fd5743d1a02246bfa6d5f7ec at {username='oryx', principal='oryx/127.26.52.124@KRBTEST.COM'} at 127.0.0.1:35826: session id = 52b69fc9fd5743d1a02246bfa6d5f7ec-00000000000000000000000000000000
I20260807 22:38:11.563467 1087 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 22:38:11.564636 1677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 22:38:11.566390 1677 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: tablet copy: Starting download of 0 data blocks...
I20260807 22:38:11.566598 1677 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: tablet copy: Starting download of 1 WAL segments...
I20260807 22:38:11.567955 1677 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 22:38:11.569453 1087 tablet_copy_service.cc:342] P 2afb5413a1a64afda69760b6e02373b6: Request end of tablet copy session 52b69fc9fd5743d1a02246bfa6d5f7ec-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.52.124@KRBTEST.COM'} at 127.0.0.1:35826
I20260807 22:38:11.569574 1087 tablet_copy_service.cc:433] P 2afb5413a1a64afda69760b6e02373b6: ending tablet copy session 52b69fc9fd5743d1a02246bfa6d5f7ec-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 52b69fc9fd5743d1a02246bfa6d5f7ec
I20260807 22:38:11.576567 1677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:11.578217 1876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:11.578301 1879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:11.578390 1877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:11.578886 1677 server_base.cc:1034] running on GCE node
I20260807 22:38:11.579062 1677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:11.579383 1677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:11.580525 1677 hybrid_clock.cc:648] HybridClock initialized: now 1786142291580537 us; error 44 us; skew 500 ppm
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:11.582015 1677 init.cc:377] Logged in from keytab as oryx/127.26.52.124@KRBTEST.COM (short username oryx)
I20260807 22:38:11.582510 1677 webserver.cc:460] Webserver started at http://127.26.52.124:40289/ using document root <none> and password file <none>
I20260807 22:38:11.582715 1677 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:11.582770 1677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:11.583961 1677 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:11.584965 1887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.585209 1677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:11.585305 1677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal
uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec"
format_stamp: "Formatted at 2026-08-07 22:38:11 on dist-test-slave-8w9v"
server_key: "a976c4592a293ed7770236e1ff5974c5"
server_key_iv: "76124ae8050ef00d72644f9d5338bacb"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.585412 1677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:11.609146 1417 heartbeater.cc:503] Master 127.26.52.126:46847 was elected leader, sending a full tablet report...
I20260807 22:38:11.614218 1677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:11.617089 1677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:11.627146 1677 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.124:45551
I20260807 22:38:11.627353 1944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.124:45551 every 8 connection(s)
I20260807 22:38:11.627926 1677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
I20260807 22:38:11.630017 1945 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:38:11.631356 1945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: Bootstrap starting.
W20260807 22:38:11.631106 1863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:11.631433 1863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:11.631495 1863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:11.637661 1863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:11.637732 1863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:11.637825 1863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:11.643235 1945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:38:11.643523 1945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: Bootstrap complete.
I20260807 22:38:11.644145 1945 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } }
I20260807 22:38:11.644285 1945 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 52b69fc9fd5743d1a02246bfa6d5f7ec, State: Initialized, Role: LEARNER
I20260807 22:38:11.644381 1945 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } }
I20260807 22:38:11.644893 1945 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:11.645053 1948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:11.645481 1948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: This master's current role is: LEARNER
I20260807 22:38:11.645936 1863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab
--principal=oryx/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:39423
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=34739
--tserver_master_addrs=127.26.52.126:46847,127.26.52.125:40057,127.26.52.124:45551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:11.647485 1863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:11.649571 1863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:38:11.649608 1960 catalog_manager.cc:1259] Loaded cluster ID: 77ea2c8a9ae943c79a86d4191877a8a5
I20260807 22:38:11.649662 1960 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: loading cluster ID for follower catalog manager: success
I20260807 22:38:11.651851 1960 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: acquiring CA information for follower catalog manager: success
I20260807 22:38:11.653358 1960 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 22:38:11.663450 1965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:11.663488 1963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:11.663697 1962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:11.663779 1863 server_base.cc:1034] running on GCE node
I20260807 22:38:11.664285 1863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:11.664920 1863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:11.666106 1863 hybrid_clock.cc:648] HybridClock initialized: now 1786142291666087 us; error 41 us; skew 500 ppm
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:11.669423 1863 init.cc:377] Logged in from keytab as oryx/127.26.52.65@KRBTEST.COM (short username oryx)
I20260807 22:38:11.670558 1863 webserver.cc:460] Webserver started at http://127.26.52.65:34739/ using document root <none> and password file <none>
I20260807 22:38:11.671240 1863 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:11.671319 1863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:11.675824 1863 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:38:11.678035 1972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.679214 1863 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:38:11.679334 1863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "8f5ac8ca5209433e9c8780fd026d8eda"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "14481e637cfec8aa0ca7b9c6ec03b1ba"
server_key_iv: "afcfa26e359563d7aa75c592950de3da"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.679949 1863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:11.712568 1863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:11.716239 1863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:11.716518 1863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:11.717263 1863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:11.718276 1863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:11.718324 1863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.718392 1863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:11.718421 1863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.741636 1863 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:39423
I20260807 22:38:11.741727 2093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:39423 every 8 connection(s)
I20260807 22:38:11.742843 1863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:11.747543 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 1863
I20260807 22:38:11.747766 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 1279
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.125@KRBTEST.COM
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.124@KRBTEST.COM
I20260807 22:38:11.765842 1839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.745260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:48301 (local address 127.26.52.125:40057)
0807 22:38:11.745506 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.745510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.746651 (+ 1141us) server_negotiation.cc:407] Connection header received
0807 22:38:11.749749 (+ 3098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.749754 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.749823 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.749906 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.752348 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.753218 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.755864 (+ 2646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.756257 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.756400 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.760992 (+ 4592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.760997 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.761000 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.761028 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.763008 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.763830 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.763835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.763837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.763935 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.764468 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.764472 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.764473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.764670 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.764793 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.765482 (+ 689us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.765639 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260807 22:38:11.767360 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.745616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:36141 (local address 127.26.52.126:46847)
0807 22:38:11.745787 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.745791 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.752728 (+ 6937us) server_negotiation.cc:407] Connection header received
0807 22:38:11.752985 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.752991 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.753064 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.753137 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.754541 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.755621 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.758095 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.758569 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.758679 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.762464 (+ 3785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.762470 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.762476 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.762510 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.764645 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.765181 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.765187 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.765192 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.765555 (+ 363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.766350 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.766354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.766356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.766586 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.766693 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.767062 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.767190 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 22:38:11.767755 2099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.745670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40057 (local address 127.26.52.65:48301)
0807 22:38:11.746500 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.746552 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.749465 (+ 2913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.750359 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.750368 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.751122 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.752107 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.752152 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.753443 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.753447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.755636 (+ 2189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.755650 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.756648 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.756653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.756902 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.758429 (+ 1527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.758452 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.760751 (+ 2299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.763170 (+ 2419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.763176 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.763193 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.763670 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.764096 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.764101 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.764103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.764341 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.764792 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.764800 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.765159 (+ 359us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.765417 (+ 258us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.765822 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":263,"threads_started":1}
I20260807 22:38:11.767985 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:40305
--local_ip_for_outbound_sockets=127.26.52.66
--tserver_master_addrs=127.26.52.126:46847
--webserver_port=35125
--webserver_interface=127.26.52.66
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab
--principal=oryx/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.52.126:46847,127.26.52.125:40057
--tserver_master_addrs=127.26.52.126:46847,127.26.52.125:40057,127.26.52.124:45551 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:38:11.768071 2101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.745675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.65:36141)
0807 22:38:11.752579 (+ 6904us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.752599 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.752819 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.753337 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.753343 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.753883 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.754354 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.754369 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.755797 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.755803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.757911 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.757939 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.758869 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.758875 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.759018 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.759660 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.759680 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.762299 (+ 2619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.764781 (+ 2482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.764787 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.764791 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.765068 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.765694 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.765700 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.765704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.766220 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.766744 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.766747 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.766850 (+ 103us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.767557 (+ 707us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.767733 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6787,"mutex_wait_us":74,"thread_start_us":1968,"threads_started":1}
I20260807 22:38:11.769264 2102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.747770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:48123 (local address 127.26.52.124:45551)
0807 22:38:11.748148 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.748155 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.756650 (+ 8495us) server_negotiation.cc:407] Connection header received
0807 22:38:11.756820 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.756826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.756905 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.757035 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.757899 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.759061 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.760433 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.760870 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.760960 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.763847 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.763851 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.763854 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.763883 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.766694 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.767371 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.767377 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.767381 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.767556 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.767911 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.767917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.767919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.768199 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.768278 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.768651 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.769005 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":144,"threads_started":1}
I20260807 22:38:11.769661 2095 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46847
I20260807 22:38:11.770416 2097 heartbeater.cc:347] Connected to a master server at 127.26.52.125:40057
I20260807 22:38:11.770174 2100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.746978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.26.52.65:48123)
0807 22:38:11.756514 (+ 9536us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.756532 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.756675 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.757067 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.757072 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.757422 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.757742 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.757749 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.759293 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.759296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.760243 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.760266 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.761157 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.761161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.761378 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.761881 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.761903 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.763670 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.766827 (+ 3157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.766833 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.766838 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.767256 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.767709 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.767714 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.767718 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.767809 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.768355 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.768360 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.768461 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.769474 (+ 1013us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.769643 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9456,"thread_start_us":141,"threads_started":1}
I20260807 22:38:11.770625 2097 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:11.770628 2095 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:11.771725 2097 heartbeater.cc:511] Master 127.26.52.125:40057 requested a full tablet report, sending...
I20260807 22:38:11.772789 2095 heartbeater.cc:511] Master 127.26.52.126:46847 requested a full tablet report, sending...
I20260807 22:38:11.773389 2096 heartbeater.cc:347] Connected to a master server at 127.26.52.124:45551
I20260807 22:38:11.773469 2096 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:11.773617 2096 heartbeater.cc:511] Master 127.26.52.124:45551 requested a full tablet report, sending...
I20260807 22:38:11.773591 1706 ts_manager.cc:194] Registered new tserver with Master: 8f5ac8ca5209433e9c8780fd026d8eda (127.26.52.65:39423)
I20260807 22:38:11.773773 1067 ts_manager.cc:194] Re-registered known tserver with Master: 8f5ac8ca5209433e9c8780fd026d8eda (127.26.52.65:39423)
I20260807 22:38:11.774688 1907 ts_manager.cc:194] Registered new tserver with Master: 8f5ac8ca5209433e9c8780fd026d8eda (127.26.52.65:39423)
I20260807 22:38:11.774696 1067 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:36141
I20260807 22:38:11.837699 1559 heartbeater.cc:503] Master 127.26.52.126:46847 was elected leader, sending a full tablet report...
W20260807 22:38:11.889452 2103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:11.889832 2103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:11.889948 2103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:11.897462 2103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:11.897547 2103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:11.897655 2103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:11.907047 2103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab
--principal=oryx/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:40305
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=35125
--tserver_master_addrs=127.26.52.126:46847,127.26.52.125:40057,127.26.52.124:45551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:11.908686 2103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:11.910243 2103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:11.923110 2108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:11.923154 2109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:11.923081 2111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:11.923297 2103 server_base.cc:1034] running on GCE node
I20260807 22:38:11.924360 2103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:11.925267 2103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:11.926489 2103 hybrid_clock.cc:648] HybridClock initialized: now 1786142291926459 us; error 37 us; skew 500 ppm
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:11.930492 2103 init.cc:377] Logged in from keytab as oryx/127.26.52.66@KRBTEST.COM (short username oryx)
I20260807 22:38:11.931886 2103 webserver.cc:460] Webserver started at http://127.26.52.66:35125/ using document root <none> and password file <none>
I20260807 22:38:11.932734 2103 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:11.932854 2103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:11.938704 2103 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:38:11.941185 2118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.942458 2103 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:11.942585 2103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "713b38abfd6046dfba31aca74ea188d3"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "9a5f9c1284d3cfe489da7de5dbcca794"
server_key_iv: "1376c20308ae8fc56201429110c5837c"
server_key_version: "encryptionkey@0"
I20260807 22:38:11.943130 2103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:11.954195 2103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:11.956841 2103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:11.957043 2103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:11.957610 2103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:11.958443 2103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:11.958490 2103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.958559 2103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:11.958588 2103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:11.975449 2103 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:40305
I20260807 22:38:11.975474 2239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:40305 every 8 connection(s)
I20260807 22:38:11.976613 2103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:11.977006 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 2103
I20260807 22:38:11.977207 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 1422
I20260807 22:38:11.990554 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:36127
--local_ip_for_outbound_sockets=127.26.52.67
--tserver_master_addrs=127.26.52.126:46847
--webserver_port=33411
--webserver_interface=127.26.52.67
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab
--principal=oryx/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.52.126:46847,127.26.52.125:40057
--tserver_master_addrs=127.26.52.126:46847,127.26.52.125:40057,127.26.52.124:45551 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.125@KRBTEST.COM
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.124@KRBTEST.COM
Aug 07 22:38:11 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142291, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:11.997182 2102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.983728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:42219 (local address 127.26.52.124:45551)
0807 22:38:11.984701 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.984708 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.984744 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:38:11.984979 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.984986 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.985051 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.985110 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.985923 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.986723 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.988775 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.989142 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.989209 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.992787 (+ 3578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.992792 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.992796 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.992827 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.994676 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.995334 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.995338 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.995341 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.995433 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.995845 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.995848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.995850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.996112 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.996227 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.996897 (+ 670us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.997032 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":873}
I20260807 22:38:11.997182 1839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.983497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:40369 (local address 127.26.52.125:40057)
0807 22:38:11.983619 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.983623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.983657 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:38:11.983877 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.983881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.983943 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.983994 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.986312 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.987208 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.988769 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.989171 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.989273 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.993185 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.993188 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.993191 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.993215 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.995258 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.995767 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.995774 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.995778 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.995865 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.996228 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.996232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.996235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.996465 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.996549 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.996883 (+ 334us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.997015 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:38:11.998468 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.980448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:40203 (local address 127.26.52.126:46847)
0807 22:38:11.980699 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:11.980703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:11.982035 (+ 1332us) server_negotiation.cc:407] Connection header received
0807 22:38:11.983879 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:11.983882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:11.983936 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:11.983994 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:11.985867 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.986738 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.988775 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.989108 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.989191 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.993180 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:11.993184 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:11.993186 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:11.993214 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:11.995469 (+ 2255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.996069 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.996073 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.996075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.996188 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:11.996558 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:11.996563 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:11.996566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:11.996822 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:11.996928 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:11.998076 (+ 1148us) server_negotiation.cc:299] Negotiation successful
0807 22:38:11.998220 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260807 22:38:11.998788 2246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.983206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.26.52.66:42219)
0807 22:38:11.984655 (+ 1449us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.984672 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.984779 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.985276 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.985281 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.985517 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.985700 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.985720 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.986907 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.986911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.988633 (+ 1722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.988644 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.989395 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.989399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.989721 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.990677 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.990693 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.992610 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.994818 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.994825 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.994840 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.995208 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.995551 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.995556 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.995559 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.995738 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.996295 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.996301 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.996607 (+ 306us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.997748 (+ 1141us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.997862 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1365,"mutex_wait_us":383,"thread_start_us":90,"threads_started":1}
I20260807 22:38:11.999114 2244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.981187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.66:40203)
0807 22:38:11.981882 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.981938 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.983589 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.984426 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.984435 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.985076 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.985697 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.985719 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.986958 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.986963 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.988633 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.988644 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.989395 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.989399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.989717 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.990596 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.990610 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.993019 (+ 2409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.995610 (+ 2591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.995616 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.995621 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.995919 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.996311 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.996317 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.996321 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.996434 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.996983 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.996988 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.997103 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.997230 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.997661 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":263,"spinlock_wait_cycles":72192,"thread_start_us":238,"threads_started":1}
I20260807 22:38:11.999591 2245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:11.982689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40057 (local address 127.26.52.66:40369)
0807 22:38:11.983209 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:11.983223 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:11.983697 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:11.984426 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:11.984435 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:11.986022 (+ 1587us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:11.986166 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.986176 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.987373 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.987380 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.988625 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:11.988639 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:11.989495 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:11.989502 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:11.989682 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:11.990328 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:11.990354 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:11.993040 (+ 2686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:11.995376 (+ 2336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.995382 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.995387 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.995652 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.995998 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:11.996000 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:11.996002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:11.996082 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:11.996608 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:11.996610 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:11.996691 (+ 81us) client_negotiation.cc:769] Sending connection context
0807 22:38:11.997388 (+ 697us) client_negotiation.cc:240] Negotiation successful
0807 22:38:11.997748 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":221,"spinlock_wait_cycles":384,"thread_start_us":193,"threads_started":1}
I20260807 22:38:12.000739 2241 heartbeater.cc:347] Connected to a master server at 127.26.52.124:45551
I20260807 22:38:12.001019 2241 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:12.001106 2242 heartbeater.cc:347] Connected to a master server at 127.26.52.125:40057
I20260807 22:38:12.001173 2242 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:12.001173 2240 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46847
I20260807 22:38:12.001298 2240 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:12.001621 2241 heartbeater.cc:511] Master 127.26.52.124:45551 requested a full tablet report, sending...
I20260807 22:38:12.001621 2240 heartbeater.cc:511] Master 127.26.52.126:46847 requested a full tablet report, sending...
I20260807 22:38:12.002254 2242 heartbeater.cc:511] Master 127.26.52.125:40057 requested a full tablet report, sending...
I20260807 22:38:12.002925 1907 ts_manager.cc:194] Registered new tserver with Master: 713b38abfd6046dfba31aca74ea188d3 (127.26.52.66:40305)
I20260807 22:38:12.002949 1067 ts_manager.cc:194] Re-registered known tserver with Master: 713b38abfd6046dfba31aca74ea188d3 (127.26.52.66:40305)
I20260807 22:38:12.003218 1706 ts_manager.cc:194] Registered new tserver with Master: 713b38abfd6046dfba31aca74ea188d3 (127.26.52.66:40305)
I20260807 22:38:12.003722 1067 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:40203
I20260807 22:38:12.084008 2248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.079896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.0.0.1:37784)
0807 22:38:12.080281 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:12.080295 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:12.080397 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:12.080732 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:12.080734 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:12.080749 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:12.080849 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.080854 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.081916 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.081920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.082685 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.082693 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.083604 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.083606 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.083674 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.083695 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:38:12.083746 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 22:38:12.083806 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":87,"threads_started":1}
I20260807 22:38:12.084048 2102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.080055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37784 (local address 127.26.52.124:45551)
0807 22:38:12.080247 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.080252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.080374 (+ 122us) server_negotiation.cc:407] Connection header received
0807 22:38:12.080509 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.080512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.080587 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.080705 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:12.080963 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.081795 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.082832 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.083480 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.083599 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.083755 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.083807 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.083881 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 22:38:12.084861 1918 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 22:38:12.085319 1948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2afb5413a1a64afda69760b6e02373b6. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:12.085466 1948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: This master's current role is: LEARNER
W20260807 22:38:12.111599 2247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:12.111893 2247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:12.111970 2247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:12.115926 2247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:12.116030 2247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:12.116137 2247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:12.121479 2247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab
--principal=oryx/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:36127
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=33411
--tserver_master_addrs=127.26.52.126:46847,127.26.52.125:40057,127.26.52.124:45551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:12.122540 2247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:12.123618 2247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:12.133446 2255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:12.133486 2247 server_base.cc:1034] running on GCE node
W20260807 22:38:12.133396 2257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:12.133384 2254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:12.134147 2247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:12.134804 2247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:12.136008 2247 hybrid_clock.cc:648] HybridClock initialized: now 1786142292135969 us; error 49 us; skew 500 ppm
Aug 07 22:38:12 dist-test-slave-8w9v krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142292, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:12.138767 2247 init.cc:377] Logged in from keytab as oryx/127.26.52.67@KRBTEST.COM (short username oryx)
I20260807 22:38:12.139643 2247 webserver.cc:460] Webserver started at http://127.26.52.67:33411/ using document root <none> and password file <none>
I20260807 22:38:12.140357 2247 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:12.140483 2247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:12.144214 2247 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260807 22:38:12.146376 2264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:12.147853 2247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 22:38:12.147979 2247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "80d3e6bbfc44402e87ba81c494fb2508"
format_stamp: "Formatted at 2026-08-07 22:38:10 on dist-test-slave-8w9v"
server_key: "f43496fd92f72e07a327ed0d9edbf2e6"
server_key_iv: "f5f3d55822274b0621a79727466da0e7"
server_key_version: "encryptionkey@0"
I20260807 22:38:12.148658 2247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:12.169567 2247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:12.172974 2247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:12.173218 2247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:12.173831 2247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:12.174700 2247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:12.174746 2247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:12.174814 2247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:12.174844 2247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:12.183938 2247 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:36127
I20260807 22:38:12.183969 2383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:36127 every 8 connection(s)
I20260807 22:38:12.184976 2247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:38:12.188819 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 2247
Aug 07 22:38:12 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142292, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
Aug 07 22:38:12 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142292, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.124@KRBTEST.COM
I20260807 22:38:12.202657 1109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.186932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:59253 (local address 127.26.52.126:46847)
0807 22:38:12.187076 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.187081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.188336 (+ 1255us) server_negotiation.cc:407] Connection header received
0807 22:38:12.189346 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.189349 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.189410 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.189476 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:12.191675 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.192494 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.194288 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.194670 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.194760 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.197968 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:12.197972 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:12.197975 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:12.198003 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:12.199834 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.200569 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.200575 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.200577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.200686 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.201143 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.201149 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.201152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.201392 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:12.201526 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.202295 (+ 769us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.202462 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:38:12.203766 2395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.190949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37652 (local address 127.26.52.125:40057)
0807 22:38:12.193270 (+ 2321us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.193275 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.193290 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:38:12.193329 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.193331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.193378 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.193516 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:12.194607 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.195379 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.196542 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.196884 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.197010 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.198715 (+ 1705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:12.198721 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:12.198724 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:12.198758 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:12.201230 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.201753 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.201755 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.201757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.201932 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.202343 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.202346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.202347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.202602 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:12.203388 (+ 786us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.203464 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.203611 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":92,"threads_started":1}
I20260807 22:38:12.204351 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.187345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.67:59253)
0807 22:38:12.188223 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:12.188237 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:12.189104 (+ 867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:12.189861 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:12.189871 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:12.190605 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:12.191526 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.191532 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.192702 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.192705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.194126 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.194137 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.194955 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.194959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.195167 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.195777 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:12.195796 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:12.197791 (+ 1995us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:12.199979 (+ 2188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:12.199987 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:12.200006 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:12.200439 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:12.200821 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:12.200825 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:12.200828 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:12.201017 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:12.201626 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:12.201633 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:12.201975 (+ 342us) client_negotiation.cc:769] Sending connection context
0807 22:38:12.202867 (+ 892us) client_negotiation.cc:240] Negotiation successful
0807 22:38:12.203235 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":791,"mutex_wait_us":559,"spinlock_wait_cycles":13696,"thread_start_us":131,"threads_started":1}
I20260807 22:38:12.205854 2384 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46847
I20260807 22:38:12.206118 2384 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:12.206384 2102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.186831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:37421 (local address 127.26.52.124:45551)
0807 22:38:12.187092 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.187098 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.188058 (+ 960us) server_negotiation.cc:407] Connection header received
0807 22:38:12.189366 (+ 1308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.189369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.189423 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.189473 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:12.191655 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.192494 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.199036 (+ 6542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.199373 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.199455 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.202649 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:12.202654 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:12.202660 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:12.202691 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:12.204496 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.205017 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.205022 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.205025 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.205108 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.205446 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.205450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.205452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.205690 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:12.205772 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.206120 (+ 348us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.206230 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"spinlock_wait_cycles":2432}
I20260807 22:38:12.206743 2384 heartbeater.cc:511] Master 127.26.52.126:46847 requested a full tablet report, sending...
I20260807 22:38:12.206899 2389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.187345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.26.52.67:37421)
0807 22:38:12.187905 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:12.187954 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:12.189098 (+ 1144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:12.189860 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:12.189868 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:12.190473 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:12.191526 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.191532 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.192684 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.192687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.198909 (+ 6222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.198922 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.199622 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.199626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.199741 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.200878 (+ 1137us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:12.200898 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:12.202485 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:12.204637 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:12.204640 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:12.204642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:12.204886 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:12.205227 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:12.205231 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:12.205233 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:12.205322 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:12.205836 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:12.205839 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:12.205940 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 22:38:12.206522 (+ 582us) client_negotiation.cc:240] Negotiation successful
0807 22:38:12.206653 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":569,"spinlock_wait_cycles":41856,"thread_start_us":129,"threads_started":1}
I20260807 22:38:12.207285 2396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.191228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35842 (local address 127.26.52.126:46847)
0807 22:38:12.193730 (+ 2502us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.193735 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.193747 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:38:12.193792 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.193795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.193836 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.194787 (+ 951us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:12.194895 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.195984 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.197898 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.198250 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.199261 (+ 1011us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.200535 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:12.200538 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:12.200541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:12.200568 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:12.203248 (+ 2680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.204190 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.204194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.204195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.204287 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.205367 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.205370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.205372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.205577 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:12.206380 (+ 803us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.206651 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.206800 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2420,"thread_start_us":87,"threads_started":1}
I20260807 22:38:12.208236 2385 heartbeater.cc:347] Connected to a master server at 127.26.52.124:45551
I20260807 22:38:12.208352 2385 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:12.208555 2385 heartbeater.cc:511] Master 127.26.52.124:45551 requested a full tablet report, sending...
I20260807 22:38:12.208603 2400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.191698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37788 (local address 127.26.52.124:45551)
0807 22:38:12.192494 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.192499 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.192510 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:38:12.192540 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.192543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.192582 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.192781 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:12.193662 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.194474 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.195839 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.196233 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.196323 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.198244 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:12.198251 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:12.198256 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:12.198288 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:12.205492 (+ 7204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.206846 (+ 1354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.206850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.206851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.206955 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.207321 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.207324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.207327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.207535 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:12.207649 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.208290 (+ 641us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.208439 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"spinlock_wait_cycles":2304,"thread_start_us":83,"threads_started":1}
I20260807 22:38:12.208667 1066 ts_manager.cc:194] Re-registered known tserver with Master: 80d3e6bbfc44402e87ba81c494fb2508 (127.26.52.67:36127)
I20260807 22:38:12.209417 1066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:59253
I20260807 22:38:12.209613 1905 ts_manager.cc:194] Registered new tserver with Master: 80d3e6bbfc44402e87ba81c494fb2508 (127.26.52.67:36127)
Aug 07 22:38:12 dist-test-slave-8w9v krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142292, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.125@KRBTEST.COM
I20260807 22:38:12.213938 1839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.188709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:37499 (local address 127.26.52.125:40057)
0807 22:38:12.188837 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.188843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.188860 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:38:12.189349 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.189353 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.189409 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.189466 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:12.192947 (+ 3481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.193758 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.207377 (+ 13619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.207709 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.207780 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.210941 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:12.210947 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:12.210950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:12.210977 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:12.212474 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.212932 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.212934 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.212935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.213007 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.213270 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.213273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.213274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.213427 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:12.213500 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.213741 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.213835 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:38:12.214022 2390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.188407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40057 (local address 127.26.52.67:37499)
0807 22:38:12.188666 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:12.188679 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:12.189098 (+ 419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:12.189860 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:12.189868 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:12.190473 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:12.191274 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.191315 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.197508 (+ 6193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.197513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.206723 (+ 9210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.206732 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.207960 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.207963 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.208109 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.208695 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:12.208710 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:12.210767 (+ 2057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:12.212595 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:12.212598 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:12.212600 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:12.212830 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:12.213090 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:12.213093 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:12.213094 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:12.213177 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:12.213518 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:12.213521 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:12.213605 (+ 84us) client_negotiation.cc:769] Sending connection context
0807 22:38:12.213703 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 22:38:12.213841 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":97,"spinlock_wait_cycles":4864,"thread_start_us":81,"threads_started":1}
I20260807 22:38:12.214630 2386 heartbeater.cc:347] Connected to a master server at 127.26.52.125:40057
I20260807 22:38:12.214738 2386 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:12.214927 2386 heartbeater.cc:511] Master 127.26.52.125:40057 requested a full tablet report, sending...
I20260807 22:38:12.212497 1066 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 22:38:12.215649 1706 ts_manager.cc:194] Registered new tserver with Master: 80d3e6bbfc44402e87ba81c494fb2508 (127.26.52.67:36127)
W20260807 22:38:12.216642 1066 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:38:12.219133 1866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: NON_VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: true } } }
I20260807 22:38:12.219259 1866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:12.222523 2403 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6: attempting to promote NON_VOTER 52b69fc9fd5743d1a02246bfa6d5f7ec to VOTER
I20260807 22:38:12.222847 2403 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } }
I20260807 22:38:12.224264 1717 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Refusing update from remote peer 2afb5413a1a64afda69760b6e02373b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 22:38:12.224596 1917 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 LEARNER]: Refusing update from remote peer 2afb5413a1a64afda69760b6e02373b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 22:38:12.224855 1866 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 22:38:12.225019 2402 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 22:38:12.227192 2402 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:12.227743 1917 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:12.228153 1717 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:12.228793 2402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:12.228884 2402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:12.228991 2402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:12.229063 2402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:12.229146 2402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:12.229228 2402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:12.229915 1948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:12.230019 1948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:38:12.230846 2411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2afb5413a1a64afda69760b6e02373b6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:12.230989 2411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:38:12.238611 2248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.232816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:36127 (local address 127.0.0.1:36340)
0807 22:38:12.232982 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:12.232997 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:12.233092 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:12.233959 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:12.233964 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:12.233982 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:12.234081 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.234086 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.235628 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.235631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.236841 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.236851 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.238006 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.238009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.238188 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.238305 (+ 117us) client_negotiation.cc:769] Sending connection context
0807 22:38:12.238382 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:38:12.238484 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"mutex_wait_us":100}
I20260807 22:38:12.238685 2416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.233884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47578 (local address 127.26.52.66:40305)
0807 22:38:12.234351 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.234364 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.234386 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:38:12.234461 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.234468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.234764 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.234913 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:12.235123 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.235796 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.236950 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.237670 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.237772 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.237940 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.238464 (+ 524us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.238551 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":156,"threads_started":1}
I20260807 22:38:12.238911 2413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.232955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36340 (local address 127.26.52.67:36127)
0807 22:38:12.233471 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.233483 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.233506 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:38:12.233584 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.233590 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.233803 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.234251 (+ 448us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:12.234391 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.235501 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.237137 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.237849 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.238133 (+ 284us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.238262 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.238433 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.238527 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":299,"threads_started":1}
I20260807 22:38:12.238977 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.233453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:40305 (local address 127.0.0.1:47578)
0807 22:38:12.233803 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:12.233819 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:12.233907 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:12.234905 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:12.234908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:12.234933 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:12.235017 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.235023 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.235913 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.235918 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.236818 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.236828 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.238022 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.238026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.238241 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.238308 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 22:38:12.238381 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 22:38:12.238863 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":515,"thread_start_us":120,"threads_started":1}
I20260807 22:38:12.241959 2314 tablet_service.cc:1467] Processing CreateTablet for tablet 7ceae4d1cf804c9a92cdef98bfbb14c1 (DEFAULT_TABLE table=test-table [id=a7b23d05d2304987bbe8d812f6269cb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:12.241953 2171 tablet_service.cc:1467] Processing CreateTablet for tablet 7ceae4d1cf804c9a92cdef98bfbb14c1 (DEFAULT_TABLE table=test-table [id=a7b23d05d2304987bbe8d812f6269cb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:12.242830 2414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.233016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:39423 (local address 127.0.0.1:34434)
0807 22:38:12.233694 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:12.233708 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:12.233795 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:12.234672 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:12.234678 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:12.234696 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:12.234782 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.234788 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.236440 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.236443 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.240453 (+ 4010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.240464 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.242412 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.242416 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.242517 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.242542 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:38:12.242617 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 22:38:12.242682 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"mutex_wait_us":23,"thread_start_us":99,"threads_started":1}
I20260807 22:38:12.243049 2171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ceae4d1cf804c9a92cdef98bfbb14c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:12.243068 2314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ceae4d1cf804c9a92cdef98bfbb14c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:12.243325 2415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.233470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34434 (local address 127.26.52.65:39423)
0807 22:38:12.234039 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.234057 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.234080 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:38:12.234151 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.234155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.234353 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.234524 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:12.235158 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.236307 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.240596 (+ 4289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.242116 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.242217 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.242343 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.243088 (+ 745us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.243187 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":81,"threads_started":1}
I20260807 22:38:12.246114 2024 tablet_service.cc:1467] Processing CreateTablet for tablet 7ceae4d1cf804c9a92cdef98bfbb14c1 (DEFAULT_TABLE table=test-table [id=a7b23d05d2304987bbe8d812f6269cb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:12.247078 2024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ceae4d1cf804c9a92cdef98bfbb14c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:12.252102 2417 tablet_bootstrap.cc:492] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: Bootstrap starting.
I20260807 22:38:12.254662 2417 tablet_bootstrap.cc:654] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:12.255918 2417 log.cc:824] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:12.258006 2417 tablet_bootstrap.cc:492] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: No bootstrap required, opened a new log
I20260807 22:38:12.258219 2417 ts_tablet_manager.cc:1397] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 22:38:12.260044 2419 tablet_bootstrap.cc:492] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: Bootstrap starting.
I20260807 22:38:12.260444 2420 tablet_bootstrap.cc:492] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: Bootstrap starting.
I20260807 22:38:12.262524 2420 tablet_bootstrap.cc:654] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:12.263461 2419 tablet_bootstrap.cc:654] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:12.263738 2420 log.cc:824] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:12.265069 2419 log.cc:824] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:12.266084 2420 tablet_bootstrap.cc:492] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: No bootstrap required, opened a new log
I20260807 22:38:12.266294 2420 ts_tablet_manager.cc:1397] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 22:38:12.266338 2417 raft_consensus.cc:348] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:12.266642 2417 raft_consensus.cc:374] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:12.266696 2417 raft_consensus.cc:729] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d3e6bbfc44402e87ba81c494fb2508, State: Initialized, Role: FOLLOWER
I20260807 22:38:12.267167 2417 consensus_queue.cc:260] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:12.267524 2419 tablet_bootstrap.cc:492] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: No bootstrap required, opened a new log
I20260807 22:38:12.267741 2419 ts_tablet_manager.cc:1397] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260807 22:38:12.268558 2384 heartbeater.cc:503] Master 127.26.52.126:46847 was elected leader, sending a full tablet report...
I20260807 22:38:12.273294 2417 ts_tablet_manager.cc:1428] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: Time spent starting tablet: real 0.015s user 0.003s sys 0.008s
I20260807 22:38:12.274044 2419 raft_consensus.cc:348] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:12.274354 2419 raft_consensus.cc:374] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:12.274413 2419 raft_consensus.cc:729] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f5ac8ca5209433e9c8780fd026d8eda, State: Initialized, Role: FOLLOWER
I20260807 22:38:12.274937 2419 consensus_queue.cc:260] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:12.275590 2420 raft_consensus.cc:348] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:12.275825 2420 raft_consensus.cc:374] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:12.275908 2420 raft_consensus.cc:729] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 713b38abfd6046dfba31aca74ea188d3, State: Initialized, Role: FOLLOWER
I20260807 22:38:12.275983 2419 ts_tablet_manager.cc:1428] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: Time spent starting tablet: real 0.008s user 0.000s sys 0.009s
I20260807 22:38:12.276460 2095 heartbeater.cc:503] Master 127.26.52.126:46847 was elected leader, sending a full tablet report...
I20260807 22:38:12.276396 2420 consensus_queue.cc:260] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:12.277150 2240 heartbeater.cc:503] Master 127.26.52.126:46847 was elected leader, sending a full tablet report...
I20260807 22:38:12.277431 2420 ts_tablet_manager.cc:1428] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: Time spent starting tablet: real 0.011s user 0.007s sys 0.003s
W20260807 22:38:12.436661 2387 tablet.cc:2369] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:38:12.485049 2243 tablet.cc:2369] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:38:12.495815 2098 tablet.cc:2369] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:38:12.598454 2423 raft_consensus.cc:482] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:12.598740 2423 raft_consensus.cc:504] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:12.600049 2423 leader_election.cc:288] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f5ac8ca5209433e9c8780fd026d8eda (127.26.52.65:39423), 713b38abfd6046dfba31aca74ea188d3 (127.26.52.66:40305)
I20260807 22:38:12.604177 2415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.600533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:59135 (local address 127.26.52.65:39423)
0807 22:38:12.600689 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.600695 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.600715 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:38:12.600771 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.600773 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.600809 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.600865 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:12.601407 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.601944 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.603034 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.603520 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.603644 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.603698 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.603961 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.604028 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:38:12.604190 2416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.600628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:39433 (local address 127.26.52.66:40305)
0807 22:38:12.600765 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.600770 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.600783 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:38:12.600834 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.600836 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.600900 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.600972 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:12.601333 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.601933 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.603084 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.603583 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.603708 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.603757 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.603983 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.604051 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:38:12.604199 2389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.600299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:40305 (local address 127.26.52.67:39433)
0807 22:38:12.600502 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:12.600519 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:12.600622 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:12.601055 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:12.601058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:12.601074 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:12.601212 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.601217 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.602040 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.602046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.602966 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.602975 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.603708 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.603712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.603843 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.603859 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 22:38:12.603962 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 22:38:12.604033 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":35}
I20260807 22:38:12.604247 2390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.600299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:39423 (local address 127.26.52.67:59135)
0807 22:38:12.600579 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:12.600594 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:12.600688 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:12.600898 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:12.600900 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:12.600945 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:12.601237 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.601246 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.602056 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.602062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.602910 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:12.602920 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.603644 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.603648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:12.603817 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.603845 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 22:38:12.603938 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 22:38:12.604013 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":72}
I20260807 22:38:12.604995 2045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ceae4d1cf804c9a92cdef98bfbb14c1" candidate_uuid: "80d3e6bbfc44402e87ba81c494fb2508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" is_pre_election: true
I20260807 22:38:12.605103 2191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ceae4d1cf804c9a92cdef98bfbb14c1" candidate_uuid: "80d3e6bbfc44402e87ba81c494fb2508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713b38abfd6046dfba31aca74ea188d3" is_pre_election: true
I20260807 22:38:12.605322 2045 raft_consensus.cc:2454] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d3e6bbfc44402e87ba81c494fb2508 in term 0.
I20260807 22:38:12.605388 2191 raft_consensus.cc:2454] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d3e6bbfc44402e87ba81c494fb2508 in term 0.
I20260807 22:38:12.605813 2268 leader_election.cc:302] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80d3e6bbfc44402e87ba81c494fb2508, 8f5ac8ca5209433e9c8780fd026d8eda; no voters:
I20260807 22:38:12.606060 2423 raft_consensus.cc:2781] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:38:12.606140 2423 raft_consensus.cc:482] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:12.606181 2423 raft_consensus.cc:3037] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:12.607529 2423 raft_consensus.cc:504] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:12.607874 2423 leader_election.cc:288] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [CANDIDATE]: Term 1 election: Requested vote from peers 8f5ac8ca5209433e9c8780fd026d8eda (127.26.52.65:39423), 713b38abfd6046dfba31aca74ea188d3 (127.26.52.66:40305)
I20260807 22:38:12.608261 2045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ceae4d1cf804c9a92cdef98bfbb14c1" candidate_uuid: "80d3e6bbfc44402e87ba81c494fb2508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f5ac8ca5209433e9c8780fd026d8eda"
I20260807 22:38:12.608268 2191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ceae4d1cf804c9a92cdef98bfbb14c1" candidate_uuid: "80d3e6bbfc44402e87ba81c494fb2508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713b38abfd6046dfba31aca74ea188d3"
I20260807 22:38:12.608363 2045 raft_consensus.cc:3037] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:12.608392 2191 raft_consensus.cc:3037] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:12.609560 2191 raft_consensus.cc:2454] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d3e6bbfc44402e87ba81c494fb2508 in term 1.
I20260807 22:38:12.609834 2045 raft_consensus.cc:2454] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d3e6bbfc44402e87ba81c494fb2508 in term 1.
I20260807 22:38:12.609871 2265 leader_election.cc:302] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 713b38abfd6046dfba31aca74ea188d3, 80d3e6bbfc44402e87ba81c494fb2508; no voters:
I20260807 22:38:12.610038 2423 raft_consensus.cc:2781] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:12.610348 2423 raft_consensus.cc:686] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 1 LEADER]: Becoming Leader. State: Replica: 80d3e6bbfc44402e87ba81c494fb2508, State: Running, Role: LEADER
I20260807 22:38:12.610698 2423 consensus_queue.cc:237] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:12.614295 1067 catalog_manager.cc:5495] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d3e6bbfc44402e87ba81c494fb2508 (127.26.52.67). New cstate: current_term: 1 leader_uuid: "80d3e6bbfc44402e87ba81c494fb2508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } health_report { overall_health: UNKNOWN } } }
I20260807 22:38:12.686079 2413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.682498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36346 (local address 127.26.52.67:36127)
0807 22:38:12.682667 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.682671 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.682683 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:38:12.682755 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.682757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.682808 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.682930 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:12.683178 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.683740 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.684614 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.684828 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.684962 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.685255 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:12.685705 (+ 450us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:12.685835 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.685876 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.685937 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:38:12.692523 2045 raft_consensus.cc:1261] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda [term 1 FOLLOWER]: Refusing update from remote peer 80d3e6bbfc44402e87ba81c494fb2508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:12.692550 2191 raft_consensus.cc:1261] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3 [term 1 FOLLOWER]: Refusing update from remote peer 80d3e6bbfc44402e87ba81c494fb2508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:12.693475 2426 consensus_queue.cc:1035] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:12.693693 2423 consensus_queue.cc:1035] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:12.702569 2430 mvcc.cc:205] Tried to move back new op lower bound from 7316038830860230656 to 7316038830535827456. Current Snapshot: MvccSnapshot[applied={T|T < 7316038830860230656}]
I20260807 22:38:12.703787 2433 mvcc.cc:205] Tried to move back new op lower bound from 7316038830860230656 to 7316038830535827456. Current Snapshot: MvccSnapshot[applied={T|T < 7316038830860230656}]
I20260807 22:38:12.709249 2432 mvcc.cc:205] Tried to move back new op lower bound from 7316038830860230656 to 7316038830535827456. Current Snapshot: MvccSnapshot[applied={T|T < 7316038830860230656}]
I20260807 22:38:12.714375 1066 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:12.714565 1066 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:12.718963 1066 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2afb5413a1a64afda69760b6e02373b6: Sending DeleteTablet for 3 replicas of tablet 7ceae4d1cf804c9a92cdef98bfbb14c1
I20260807 22:38:12.719964 2024 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ceae4d1cf804c9a92cdef98bfbb14c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:12 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:34434
I20260807 22:38:12.719987 2171 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ceae4d1cf804c9a92cdef98bfbb14c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:12 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:47578
I20260807 22:38:12.720602 2441 tablet_replica.cc:330] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: stopping tablet replica
I20260807 22:38:12.720852 2442 tablet_replica.cc:330] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: stopping tablet replica
I20260807 22:38:12.721050 2314 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ceae4d1cf804c9a92cdef98bfbb14c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:12 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:36340
I20260807 22:38:12.721227 2442 raft_consensus.cc:2229] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:12.721235 2441 raft_consensus.cc:2229] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:12.721562 2442 raft_consensus.cc:2258] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:12.721676 2441 raft_consensus.cc:2258] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:12.723237 2442 ts_tablet_manager.cc:1905] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:12.723392 2441 ts_tablet_manager.cc:1905] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:12.724781 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 1033
I20260807 22:38:12.728154 2442 ts_tablet_manager.cc:1918] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:12.728276 2442 log.cc:1196] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/7ceae4d1cf804c9a92cdef98bfbb14c1
I20260807 22:38:12.728627 2442 ts_tablet_manager.cc:1939] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 713b38abfd6046dfba31aca74ea188d3: Deleting consensus metadata
I20260807 22:38:12.729075 2441 ts_tablet_manager.cc:1918] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:12.729228 2441 log.cc:1196] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/7ceae4d1cf804c9a92cdef98bfbb14c1
I20260807 22:38:12.729650 2441 ts_tablet_manager.cc:1939] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 8f5ac8ca5209433e9c8780fd026d8eda: Deleting consensus metadata
I20260807 22:38:12.732926 2443 tablet_replica.cc:330] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: stopping tablet replica
I20260807 22:38:12.733230 2443 raft_consensus.cc:2229] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:38:12.733614 2443 raft_consensus.cc:2258] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:12.735193 2443 ts_tablet_manager.cc:1905] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 22:38:12.735404 2122 connection.cc:535] server connection from 127.0.0.1:47578 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 22:38:12.735775 1973 connection.cc:535] server connection from 127.0.0.1:34434 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 22:38:12.738168 2443 ts_tablet_manager.cc:1918] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:12.738265 2443 log.cc:1196] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/7ceae4d1cf804c9a92cdef98bfbb14c1
I20260807 22:38:12.738579 2443 ts_tablet_manager.cc:1939] T 7ceae4d1cf804c9a92cdef98bfbb14c1 P 80d3e6bbfc44402e87ba81c494fb2508: Deleting consensus metadata
W20260807 22:38:12.739511 2265 connection.cc:441] server connection from 127.0.0.1:36340 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36340 (request call id 1) could send its response
I20260807 22:38:12.743885 2445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.722985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37658 (local address 127.26.52.125:40057)
0807 22:38:12.732333 (+ 9348us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.732338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.732612 (+ 274us) server_negotiation.cc:407] Connection header received
0807 22:38:12.732753 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.732759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.732833 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.732925 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:12.734242 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.735146 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.736683 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.737023 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.737121 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.739411 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:12.739426 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:12.739429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:12.739454 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:12.741648 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.742133 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.742140 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.742145 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.742235 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.742553 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.742556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.742558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.742796 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:12.742944 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.743611 (+ 667us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.743724 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9259,"thread_start_us":85,"threads_started":1}
I20260807 22:38:12.751780 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.740693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37670 (local address 127.26.52.125:40057)
0807 22:38:12.740897 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.740901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.742289 (+ 1388us) server_negotiation.cc:407] Connection header received
0807 22:38:12.742328 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.742331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.742375 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.742455 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:12.743278 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.744088 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.745346 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.745658 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.745760 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.747610 (+ 1850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:12.747613 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:12.747616 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:12.747639 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:12.749410 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.749939 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.749947 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.749949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.750052 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.750387 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.750390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.750392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.750596 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:12.750718 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.751374 (+ 656us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.751492 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":79,"threads_started":1}
I20260807 22:38:12.754956 2446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.723176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37800 (local address 127.26.52.124:45551)
0807 22:38:12.738333 (+ 15157us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.738340 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.744475 (+ 6135us) server_negotiation.cc:407] Connection header received
0807 22:38:12.744635 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.744638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.744685 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.744742 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:12.746092 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.747287 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.748565 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.748959 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.749041 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.750698 (+ 1657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:12.750702 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:12.750704 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:12.750731 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:12.752860 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.753462 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.753465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.753469 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.753580 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.753905 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.753911 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.753914 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.754123 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:12.754222 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.754657 (+ 435us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.754763 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15075,"thread_start_us":68,"threads_started":1}
I20260807 22:38:12.761322 2455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:12.741177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37814 (local address 127.26.52.124:45551)
0807 22:38:12.741663 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:12.741668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:12.746424 (+ 4756us) server_negotiation.cc:407] Connection header received
0807 22:38:12.752972 (+ 6548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:12.752977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:12.753026 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:12.753099 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:12.753972 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.754764 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.756316 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:12.756622 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:12.756680 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:12.758132 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:12.758135 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:12.758138 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:12.758161 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:12.759650 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.760074 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.760077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.760079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.760176 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:12.760461 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:12.760465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:12.760467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:12.760633 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:12.760763 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:12.761011 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 22:38:12.761131 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":63,"threads_started":1}
I20260807 22:38:13.707345 2457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:13.706777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.65:53371)
0807 22:38:13.707092 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:13.707213 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":76,"threads_started":1}
W20260807 22:38:13.707904 2095 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:46847 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
I20260807 22:38:13.709098 2458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:13.708491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.67:43413)
0807 22:38:13.708889 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:13.708994 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":74,"threads_started":1}
I20260807 22:38:13.709359 2459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:13.708716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.66:49655)
0807 22:38:13.709153 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:13.709241 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":68,"threads_started":1}
W20260807 22:38:13.709444 2384 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:46847 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
W20260807 22:38:13.709611 2240 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:46847 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
I20260807 22:38:14.219480 2460 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2afb5413a1a64afda69760b6e02373b6)
I20260807 22:38:14.219697 2460 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } }
I20260807 22:38:14.220355 2461 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2afb5413a1a64afda69760b6e02373b6)
I20260807 22:38:14.220491 2461 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } }
I20260807 22:38:14.220860 2460 leader_election.cc:288] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847), 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124:45551)
I20260807 22:38:14.221005 2461 leader_election.cc:288] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847), 0813591a252644dab7d6a557c9557f15 (127.26.52.125:40057)
I20260807 22:38:14.221483 2463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.220989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:56862)
0807 22:38:14.221301 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.221381 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":95,"threads_started":1}
W20260807 22:38:14.221725 1691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
I20260807 22:38:14.222007 2467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.221642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:56878)
0807 22:38:14.221839 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.221903 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":78,"threads_started":1}
W20260807 22:38:14.222159 1889 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
I20260807 22:38:14.222772 2463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.222465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:56884)
0807 22:38:14.222657 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.222705 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260807 22:38:14.222952 2467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.222723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:56886)
0807 22:38:14.222848 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.222892 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 22:38:14.222962 1691 leader_election.cc:334] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847): Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
W20260807 22:38:14.223078 1889 leader_election.cc:334] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847): Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
I20260807 22:38:14.225302 2466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.221264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44128 (local address 127.26.52.125:40057)
0807 22:38:14.221808 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:14.221813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:14.221824 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:38:14.221864 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:14.221867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:14.221913 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:14.221997 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:14.222391 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:14.223178 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:14.224321 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:14.224732 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:14.224849 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:14.224907 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:14.225128 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 22:38:14.225195 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":59,"threads_started":1}
I20260807 22:38:14.225304 2465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.221216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40057 (local address 127.0.0.1:44128)
0807 22:38:14.221507 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.221523 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:14.221621 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:14.222129 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:14.222132 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:14.222150 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:14.222261 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:14.222271 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:14.223343 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:14.223350 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:14.224200 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:14.224217 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:14.224850 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:14.224853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:14.225004 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:14.225023 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 22:38:14.225108 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 22:38:14.225181 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":23,"thread_start_us":61,"threads_started":1}
I20260807 22:38:14.225670 2464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.221047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:45551 (local address 127.0.0.1:47544)
0807 22:38:14.221379 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.221397 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:14.221497 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:14.222663 (+ 1166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:14.222667 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:14.222684 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:14.222771 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:14.222778 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:14.223708 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:14.223716 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:14.224534 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:14.224544 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:14.225264 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:14.225268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:14.225364 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:14.225398 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 22:38:14.225479 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 22:38:14.225554 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":73,"threads_started":1}
I20260807 22:38:14.225718 2468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.221833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47544 (local address 127.26.52.124:45551)
0807 22:38:14.222006 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:14.222010 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:14.222025 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:38:14.222474 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:14.222480 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:14.222530 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:14.222885 (+ 355us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:14.222989 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:14.223584 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:14.224653 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:14.225143 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:14.225261 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:14.225314 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:14.225541 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 22:38:14.225607 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":122,"thread_start_us":53,"threads_started":1}
I20260807 22:38:14.225973 1717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0813591a252644dab7d6a557c9557f15" is_pre_election: true
I20260807 22:38:14.226115 1717 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52b69fc9fd5743d1a02246bfa6d5f7ec in term 1.
I20260807 22:38:14.226194 1917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0813591a252644dab7d6a557c9557f15" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" is_pre_election: true
I20260807 22:38:14.226402 1917 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0813591a252644dab7d6a557c9557f15 in term 1.
I20260807 22:38:14.226444 1891 leader_election.cc:302] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0813591a252644dab7d6a557c9557f15, 52b69fc9fd5743d1a02246bfa6d5f7ec; no voters: 2afb5413a1a64afda69760b6e02373b6
I20260807 22:38:14.226603 2461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 22:38:14.226658 2461 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2afb5413a1a64afda69760b6e02373b6)
I20260807 22:38:14.226697 2461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:38:14.226755 1693 leader_election.cc:302] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0813591a252644dab7d6a557c9557f15, 52b69fc9fd5743d1a02246bfa6d5f7ec; no voters: 2afb5413a1a64afda69760b6e02373b6
I20260807 22:38:14.226961 2460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 22:38:14.227020 2460 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2afb5413a1a64afda69760b6e02373b6)
I20260807 22:38:14.227058 2460 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:38:14.228032 2461 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } }
I20260807 22:38:14.228236 2460 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } }
I20260807 22:38:14.228438 2461 leader_election.cc:288] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [CANDIDATE]: Term 2 election: Requested vote from peers 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847), 0813591a252644dab7d6a557c9557f15 (127.26.52.125:40057)
I20260807 22:38:14.228614 2460 leader_election.cc:288] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 2 election: Requested vote from peers 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847), 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124:45551)
I20260807 22:38:14.228938 2464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.228686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:56914)
0807 22:38:14.228807 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.228863 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 22:38:14.228976 1917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0813591a252644dab7d6a557c9557f15" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec"
I20260807 22:38:14.228976 1717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0813591a252644dab7d6a557c9557f15"
I20260807 22:38:14.229058 2465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.228641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:56898)
0807 22:38:14.228944 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.228999 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242}
I20260807 22:38:14.229116 1717 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 52b69fc9fd5743d1a02246bfa6d5f7ec in current term 2: Already voted for candidate 0813591a252644dab7d6a557c9557f15 in this term.
I20260807 22:38:14.229121 1917 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0813591a252644dab7d6a557c9557f15 in current term 2: Already voted for candidate 52b69fc9fd5743d1a02246bfa6d5f7ec in this term.
I20260807 22:38:14.229765 2464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.229563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:56918)
0807 22:38:14.229645 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.229687 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 22:38:14.229900 2465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.229683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:56928)
0807 22:38:14.229796 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.229848 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 22:38:14.229885 1691 leader_election.cc:334] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847): Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
I20260807 22:38:14.229985 1691 leader_election.cc:302] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0813591a252644dab7d6a557c9557f15; no voters: 2afb5413a1a64afda69760b6e02373b6, 52b69fc9fd5743d1a02246bfa6d5f7ec
I20260807 22:38:14.230140 2460 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 22:38:14.230244 1889 leader_election.cc:334] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847): Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
I20260807 22:38:14.230319 1889 leader_election.cc:302] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52b69fc9fd5743d1a02246bfa6d5f7ec; no voters: 0813591a252644dab7d6a557c9557f15, 2afb5413a1a64afda69760b6e02373b6
I20260807 22:38:14.230468 2461 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 22:38:14.709359 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.708880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.65:41235)
0807 22:38:14.709171 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.709245 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":90,"threads_started":1}
I20260807 22:38:14.710577 2472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.709972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.67:37307)
0807 22:38:14.710429 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.710487 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":101,"threads_started":1}
I20260807 22:38:14.710974 2473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:14.710101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.66:58649)
0807 22:38:14.710369 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:14.710858 (+ 489us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":87,"threads_started":1}
I20260807 22:38:15.711726 2474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.710627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.65:41193)
0807 22:38:15.711527 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.711602 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":111,"threads_started":1}
I20260807 22:38:15.712376 2475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.711589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.66:40521)
0807 22:38:15.712229 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.712289 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":67,"threads_started":1}
I20260807 22:38:15.712435 2476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.711650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.67:41277)
0807 22:38:15.712284 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.712345 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":69,"threads_started":1}
I20260807 22:38:15.843302 2477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:15.843446 2477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } }
I20260807 22:38:15.843961 2477 leader_election.cc:288] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847), 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124:45551)
I20260807 22:38:15.844429 1917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0813591a252644dab7d6a557c9557f15" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" is_pre_election: true
I20260807 22:38:15.844605 1917 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0813591a252644dab7d6a557c9557f15 in term 2.
I20260807 22:38:15.844580 2478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.844172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:57166)
0807 22:38:15.844391 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.844458 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":70,"threads_started":1}
I20260807 22:38:15.845007 1693 leader_election.cc:302] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0813591a252644dab7d6a557c9557f15, 52b69fc9fd5743d1a02246bfa6d5f7ec; no voters:
I20260807 22:38:15.845186 2477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 22:38:15.845265 2477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:15.845352 2477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:38:15.845464 2478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.845203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:57172)
0807 22:38:15.845324 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.845378 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 22:38:15.845580 1691 leader_election.cc:334] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847): Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
I20260807 22:38:15.846696 2477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } }
I20260807 22:38:15.847062 2477 leader_election.cc:288] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 3 election: Requested vote from peers 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847), 52b69fc9fd5743d1a02246bfa6d5f7ec (127.26.52.124:45551)
I20260807 22:38:15.847383 2478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.847180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:57180)
0807 22:38:15.847269 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.847319 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 22:38:15.847460 1917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0813591a252644dab7d6a557c9557f15" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec"
I20260807 22:38:15.847584 1917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:38:15.848738 2478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.848541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:57184)
0807 22:38:15.848641 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.848685 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 22:38:15.848740 1917 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0813591a252644dab7d6a557c9557f15 in term 3.
W20260807 22:38:15.848840 1691 leader_election.cc:334] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847): Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
I20260807 22:38:15.849045 1693 leader_election.cc:302] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0813591a252644dab7d6a557c9557f15, 52b69fc9fd5743d1a02246bfa6d5f7ec; no voters: 2afb5413a1a64afda69760b6e02373b6
I20260807 22:38:15.849241 2477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 22:38:15.849422 2477 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [term 3 LEADER]: Becoming Leader. State: Replica: 0813591a252644dab7d6a557c9557f15, State: Running, Role: LEADER
I20260807 22:38:15.849682 2477 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } }
I20260807 22:38:15.850975 2481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0813591a252644dab7d6a557c9557f15. Latest consensus state: current_term: 3 leader_uuid: "0813591a252644dab7d6a557c9557f15" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:15.851091 2481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:15.851392 2483 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:15.854054 2483 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:15.854444 2483 catalog_manager.cc:1259] Loaded cluster ID: 77ea2c8a9ae943c79a86d4191877a8a5
I20260807 22:38:15.854490 2483 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:15.854981 2483 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:15.855325 2483 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Loaded TSK: 0
I20260807 22:38:15.855948 2483 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:38:15.895543 1705 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37670:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:38:15.898701 1705 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:38:15.901682 2478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.901391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:57204)
0807 22:38:15.901543 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.901603 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 22:38:15.901698 1917 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [term 3 FOLLOWER]: Refusing update from remote peer 0813591a252644dab7d6a557c9557f15: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260807 22:38:15.902227 2481 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 22:38:15.902400 2478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.902160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.0.0.1:57212)
0807 22:38:15.902276 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.902327 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 22:38:15.902532 1691 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 -> Peer 2afb5413a1a64afda69760b6e02373b6 (127.26.52.126:46847): Couldn't send request to peer 2afb5413a1a64afda69760b6e02373b6. Status: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 22:38:15.903623 2485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0813591a252644dab7d6a557c9557f15. Latest consensus state: current_term: 3 leader_uuid: "0813591a252644dab7d6a557c9557f15" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:15.903779 2485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:38:15.904837 2481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "0813591a252644dab7d6a557c9557f15" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:15.905009 2481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:15.905148 2485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "0813591a252644dab7d6a557c9557f15" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "2afb5413a1a64afda69760b6e02373b6" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46847 } } peers { permanent_uuid: "0813591a252644dab7d6a557c9557f15" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40057 } attrs { promote: false } } peers { permanent_uuid: "52b69fc9fd5743d1a02246bfa6d5f7ec" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 45551 } attrs { promote: false } } }
I20260807 22:38:15.905269 2485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b69fc9fd5743d1a02246bfa6d5f7ec [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:38:15.916093 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.911102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:36127 (local address 127.0.0.1:32886)
0807 22:38:15.911353 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.911367 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:15.911455 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:15.912083 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:15.912087 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:15.912109 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:15.912232 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:15.912241 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.913393 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.913395 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:15.914675 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:15.914684 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.915652 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.915654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:15.915761 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:15.915787 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:38:15.915867 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:38:15.915947 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":87,"thread_start_us":103,"threads_started":1}
I20260807 22:38:15.916152 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.911235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32886 (local address 127.26.52.67:36127)
0807 22:38:15.911496 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:15.911543 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:15.911561 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:38:15.911619 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:15.911644 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:15.911721 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:15.911810 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:15.912550 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.913294 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.914907 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.915527 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.915659 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:15.915740 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:15.915900 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 22:38:15.915986 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":95,"threads_started":1}
I20260807 22:38:15.916829 2314 tablet_service.cc:1467] Processing CreateTablet for tablet 559638bb914d4638adf7df7b6ca29302 (DEFAULT_TABLE table=test-table [id=7fc2b26e11bd4a82850df9dfcde18321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:15.916949 2478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.910829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:39423 (local address 127.0.0.1:39012)
0807 22:38:15.910933 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.910949 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:15.911046 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:15.911941 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:15.911944 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:15.911959 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:15.912083 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:15.912090 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.913276 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.913278 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:15.914673 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:15.914684 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.916553 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.916557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:15.916649 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:15.916671 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:38:15.916750 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 22:38:15.916810 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":73}
I20260807 22:38:15.916996 2493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.911382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39012 (local address 127.26.52.65:39423)
0807 22:38:15.911690 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:15.911694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:15.911708 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:38:15.911762 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:15.911768 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:15.911818 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:15.912232 (+ 414us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:15.912355 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.913157 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.914806 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.916380 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.916557 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:15.916624 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:15.916778 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 22:38:15.916863 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":101,"threads_started":1}
I20260807 22:38:15.917148 2314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 559638bb914d4638adf7df7b6ca29302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:15.917404 2494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.911785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:40305 (local address 127.0.0.1:56454)
0807 22:38:15.912216 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.912229 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:15.912318 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:15.913680 (+ 1362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:15.913682 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:15.913699 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:15.913782 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:15.913788 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.914514 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.914520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:15.915601 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:15.915611 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.917025 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.917028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:15.917114 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:15.917141 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:38:15.917231 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:38:15.917293 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":88,"threads_started":1}
I20260807 22:38:15.917459 2495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.911894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56454 (local address 127.26.52.66:40305)
0807 22:38:15.913475 (+ 1581us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:15.913478 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:15.913490 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:38:15.913533 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:15.913535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:15.913572 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:15.913671 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:15.913903 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.914402 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.915719 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:15.916801 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:15.916899 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:15.916961 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:15.917253 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 22:38:15.917336 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1505,"thread_start_us":74,"threads_started":1}
I20260807 22:38:15.917580 2024 tablet_service.cc:1467] Processing CreateTablet for tablet 559638bb914d4638adf7df7b6ca29302 (DEFAULT_TABLE table=test-table [id=7fc2b26e11bd4a82850df9dfcde18321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:15.917835 2024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 559638bb914d4638adf7df7b6ca29302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:15.917956 2171 tablet_service.cc:1467] Processing CreateTablet for tablet 559638bb914d4638adf7df7b6ca29302 (DEFAULT_TABLE table=test-table [id=7fc2b26e11bd4a82850df9dfcde18321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:15.918247 2171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 559638bb914d4638adf7df7b6ca29302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:15.920277 2496 tablet_bootstrap.cc:492] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508: Bootstrap starting.
I20260807 22:38:15.920437 2498 tablet_bootstrap.cc:492] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda: Bootstrap starting.
I20260807 22:38:15.920780 2497 tablet_bootstrap.cc:492] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3: Bootstrap starting.
I20260807 22:38:15.921206 2496 tablet_bootstrap.cc:654] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:15.921351 2498 tablet_bootstrap.cc:654] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:15.921756 2497 tablet_bootstrap.cc:654] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:15.922489 2496 tablet_bootstrap.cc:492] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508: No bootstrap required, opened a new log
I20260807 22:38:15.922606 2496 ts_tablet_manager.cc:1397] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:38:15.922616 2498 tablet_bootstrap.cc:492] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda: No bootstrap required, opened a new log
I20260807 22:38:15.922695 2498 ts_tablet_manager.cc:1397] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:15.923009 2496 raft_consensus.cc:348] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:15.923103 2496 raft_consensus.cc:374] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:15.923125 2496 raft_consensus.cc:729] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d3e6bbfc44402e87ba81c494fb2508, State: Initialized, Role: FOLLOWER
I20260807 22:38:15.923069 2498 raft_consensus.cc:348] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:15.923205 2498 raft_consensus.cc:374] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:15.923254 2498 raft_consensus.cc:729] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f5ac8ca5209433e9c8780fd026d8eda, State: Initialized, Role: FOLLOWER
I20260807 22:38:15.923267 2496 consensus_queue.cc:260] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:15.923380 2498 consensus_queue.cc:260] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:15.923688 2496 ts_tablet_manager.cc:1428] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:15.923756 2498 ts_tablet_manager.cc:1428] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:15.924618 2474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.924392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.65:49951)
0807 22:38:15.924490 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.924543 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 22:38:15.925340 2474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.925100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.65:40361)
0807 22:38:15.925237 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.925282 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 22:38:15.924360 2476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.924028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.67:39977)
0807 22:38:15.924225 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.924283 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260807 22:38:15.926319 2476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.926067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.67:54735)
0807 22:38:15.926211 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.926261 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260807 22:38:15.926839 2386 heartbeater.cc:503] Master 127.26.52.125:40057 was elected leader, sending a full tablet report...
I20260807 22:38:15.927117 2497 tablet_bootstrap.cc:492] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3: No bootstrap required, opened a new log
I20260807 22:38:15.927228 2497 ts_tablet_manager.cc:1397] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260807 22:38:15.927630 2497 raft_consensus.cc:348] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:15.927742 2497 raft_consensus.cc:374] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:15.927788 2497 raft_consensus.cc:729] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 713b38abfd6046dfba31aca74ea188d3, State: Initialized, Role: FOLLOWER
I20260807 22:38:15.927923 2497 consensus_queue.cc:260] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:15.928368 2497 ts_tablet_manager.cc:1428] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260807 22:38:15.928902 2475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.928643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.66:50859)
0807 22:38:15.928760 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.928834 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 22:38:15.929579 2475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:15.929351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.66:56151)
0807 22:38:15.929466 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:15.929520 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 22:38:15.930047 2242 heartbeater.cc:503] Master 127.26.52.125:40057 was elected leader, sending a full tablet report...
I20260807 22:38:16.065848 2502 raft_consensus.cc:482] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:16.066051 2502 raft_consensus.cc:504] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:16.066553 2502 leader_election.cc:288] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f5ac8ca5209433e9c8780fd026d8eda (127.26.52.65:39423), 713b38abfd6046dfba31aca74ea188d3 (127.26.52.66:40305)
I20260807 22:38:16.066982 2045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "559638bb914d4638adf7df7b6ca29302" candidate_uuid: "80d3e6bbfc44402e87ba81c494fb2508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" is_pre_election: true
I20260807 22:38:16.067152 2045 raft_consensus.cc:2454] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d3e6bbfc44402e87ba81c494fb2508 in term 0.
I20260807 22:38:16.067101 2191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "559638bb914d4638adf7df7b6ca29302" candidate_uuid: "80d3e6bbfc44402e87ba81c494fb2508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713b38abfd6046dfba31aca74ea188d3" is_pre_election: true
I20260807 22:38:16.067301 2191 raft_consensus.cc:2454] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80d3e6bbfc44402e87ba81c494fb2508 in term 0.
I20260807 22:38:16.067518 2268 leader_election.cc:302] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80d3e6bbfc44402e87ba81c494fb2508, 8f5ac8ca5209433e9c8780fd026d8eda; no voters:
I20260807 22:38:16.067718 2502 raft_consensus.cc:2781] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:38:16.067790 2502 raft_consensus.cc:482] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:16.067835 2502 raft_consensus.cc:3037] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:16.068887 2502 raft_consensus.cc:504] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:16.069203 2502 leader_election.cc:288] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [CANDIDATE]: Term 1 election: Requested vote from peers 8f5ac8ca5209433e9c8780fd026d8eda (127.26.52.65:39423), 713b38abfd6046dfba31aca74ea188d3 (127.26.52.66:40305)
I20260807 22:38:16.069518 2045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "559638bb914d4638adf7df7b6ca29302" candidate_uuid: "80d3e6bbfc44402e87ba81c494fb2508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f5ac8ca5209433e9c8780fd026d8eda"
I20260807 22:38:16.069567 2191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "559638bb914d4638adf7df7b6ca29302" candidate_uuid: "80d3e6bbfc44402e87ba81c494fb2508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713b38abfd6046dfba31aca74ea188d3"
I20260807 22:38:16.069650 2045 raft_consensus.cc:3037] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:16.069664 2191 raft_consensus.cc:3037] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:16.070753 2045 raft_consensus.cc:2454] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d3e6bbfc44402e87ba81c494fb2508 in term 1.
I20260807 22:38:16.070753 2191 raft_consensus.cc:2454] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80d3e6bbfc44402e87ba81c494fb2508 in term 1.
I20260807 22:38:16.071049 2268 leader_election.cc:302] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80d3e6bbfc44402e87ba81c494fb2508, 8f5ac8ca5209433e9c8780fd026d8eda; no voters:
I20260807 22:38:16.071233 2502 raft_consensus.cc:2781] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:16.071441 2502 raft_consensus.cc:686] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 1 LEADER]: Becoming Leader. State: Replica: 80d3e6bbfc44402e87ba81c494fb2508, State: Running, Role: LEADER
I20260807 22:38:16.071600 2502 consensus_queue.cc:237] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } } peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } }
I20260807 22:38:16.072196 2476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:16.071884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.67:41647)
0807 22:38:16.072025 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:16.072091 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 22:38:16.073441 1706 catalog_manager.cc:5495] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80d3e6bbfc44402e87ba81c494fb2508 (127.26.52.67). New cstate: current_term: 1 leader_uuid: "80d3e6bbfc44402e87ba81c494fb2508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80d3e6bbfc44402e87ba81c494fb2508" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 36127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 } health_report { overall_health: UNKNOWN } } }
I20260807 22:38:16.103464 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:16.100232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32894 (local address 127.26.52.67:36127)
0807 22:38:16.100405 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:16.100410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:16.100435 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:38:16.100566 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:16.100576 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:16.100621 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:16.100698 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:16.100971 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:16.101491 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:16.102344 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:16.102579 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:16.102692 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:16.102955 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:16.103032 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:16.103115 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:16.103244 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 22:38:16.103313 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 22:38:16.105681 2045 raft_consensus.cc:1261] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda [term 1 FOLLOWER]: Refusing update from remote peer 80d3e6bbfc44402e87ba81c494fb2508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:16.105715 2191 raft_consensus.cc:1261] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3 [term 1 FOLLOWER]: Refusing update from remote peer 80d3e6bbfc44402e87ba81c494fb2508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:16.106200 2505 consensus_queue.cc:1035] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f5ac8ca5209433e9c8780fd026d8eda" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:16.106359 2502 consensus_queue.cc:1035] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "713b38abfd6046dfba31aca74ea188d3" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:16.107831 2097 heartbeater.cc:503] Master 127.26.52.125:40057 was elected leader, sending a full tablet report...
I20260807 22:38:16.108718 2474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:16.108414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.65:33847)
0807 22:38:16.108558 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:16.108619 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 22:38:16.109781 2475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:16.109442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.66:49483)
0807 22:38:16.109648 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:16.109706 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260807 22:38:16.112056 2475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:16.111754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.66:52277)
0807 22:38:16.111940 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:16.111996 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260807 22:38:16.113082 2476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:16.111529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.67:55255)
0807 22:38:16.112055 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:16.112108 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460}
I20260807 22:38:16.114267 2474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:16.113822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.65:33073)
0807 22:38:16.114127 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:16.114178 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214}
I20260807 22:38:16.115198 2476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:16.114412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46847 (local address 127.26.52.67:56113)
0807 22:38:16.115078 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:16.115132 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:46847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":595}
I20260807 22:38:16.117165 1706 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:16.117324 1706 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:16.120725 1706 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0813591a252644dab7d6a557c9557f15: Sending DeleteTablet for 3 replicas of tablet 559638bb914d4638adf7df7b6ca29302
I20260807 22:38:16.121374 2024 tablet_service.cc:1514] Processing DeleteTablet for tablet 559638bb914d4638adf7df7b6ca29302 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:16 UTC) from {username='oryx', principal='oryx/127.26.52.125@KRBTEST.COM'} at 127.0.0.1:39012
I20260807 22:38:16.121615 2171 tablet_service.cc:1514] Processing DeleteTablet for tablet 559638bb914d4638adf7df7b6ca29302 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:16 UTC) from {username='oryx', principal='oryx/127.26.52.125@KRBTEST.COM'} at 127.0.0.1:56454
I20260807 22:38:16.121676 2314 tablet_service.cc:1514] Processing DeleteTablet for tablet 559638bb914d4638adf7df7b6ca29302 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:16 UTC) from {username='oryx', principal='oryx/127.26.52.125@KRBTEST.COM'} at 127.0.0.1:32886
I20260807 22:38:16.121717 2518 tablet_replica.cc:330] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda: stopping tablet replica
I20260807 22:38:16.121850 2518 raft_consensus.cc:2229] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:16.121929 2519 tablet_replica.cc:330] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3: stopping tablet replica
I20260807 22:38:16.121985 2518 raft_consensus.cc:2258] T 559638bb914d4638adf7df7b6ca29302 P 8f5ac8ca5209433e9c8780fd026d8eda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:16.122048 2519 raft_consensus.cc:2229] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:16.122200 2519 raft_consensus.cc:2258] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:16.122426 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 1863
I20260807 22:38:16.125244 2519 ts_tablet_manager.cc:1905] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:16.128288 2520 tablet_replica.cc:330] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508: stopping tablet replica
I20260807 22:38:16.128432 2520 raft_consensus.cc:2229] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:38:16.128607 2519 ts_tablet_manager.cc:1918] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:16.128639 2520 raft_consensus.cc:2258] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:16.128691 2519 log.cc:1196] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/559638bb914d4638adf7df7b6ca29302
I20260807 22:38:16.129026 2519 ts_tablet_manager.cc:1939] T 559638bb914d4638adf7df7b6ca29302 P 713b38abfd6046dfba31aca74ea188d3: Deleting consensus metadata
I20260807 22:38:16.129264 2520 ts_tablet_manager.cc:1905] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:16.129799 1690 catalog_manager.cc:4841] TS 713b38abfd6046dfba31aca74ea188d3 (127.26.52.66:40305): tablet 559638bb914d4638adf7df7b6ca29302 (table test-table [id=7fc2b26e11bd4a82850df9dfcde18321]) successfully deleted
I20260807 22:38:16.131362 2520 ts_tablet_manager.cc:1918] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:16.131470 2520 log.cc:1196] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/559638bb914d4638adf7df7b6ca29302
I20260807 22:38:16.131748 2520 ts_tablet_manager.cc:1939] T 559638bb914d4638adf7df7b6ca29302 P 80d3e6bbfc44402e87ba81c494fb2508: Deleting consensus metadata
I20260807 22:38:16.132373 1691 catalog_manager.cc:4841] TS 80d3e6bbfc44402e87ba81c494fb2508 (127.26.52.67:36127): tablet 559638bb914d4638adf7df7b6ca29302 (table test-table [id=7fc2b26e11bd4a82850df9dfcde18321]) successfully deleted
I20260807 22:38:16.133170 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 2103
I20260807 22:38:16.133518 2494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:16.133191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:39423 (local address 127.0.0.1:39016)
0807 22:38:16.133347 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:16.133413 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:39423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 22:38:16.134544 1693 catalog_manager.cc:4584] TS 8f5ac8ca5209433e9c8780fd026d8eda (127.26.52.65:39423): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 559638bb914d4638adf7df7b6ca29302: Network error: Client connection negotiation failed: client connection to 127.26.52.65:39423: connect: Connection refused (error 111)
I20260807 22:38:16.142165 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 2247
I20260807 22:38:16.150498 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 1565
I20260807 22:38:16.157352 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 1677
2026-08-07T22:38:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7495 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:38:16 dist-test-slave-8w9v krb5kdc[2524](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:38:16 dist-test-slave-8w9v krb5kdc[2524](info): set up 2 sockets
Aug 07 22:38:16 dist-test-slave-8w9v krb5kdc[2524](info): commencing operation
krb5kdc: starting...
W20260807 22:38:17.244560 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:38:17 dist-test-slave-8w9v krb5kdc[2524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:38:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.126.keytab.
Entry for principal oryx/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.126.keytab.
I20260807 22:38:17.369539 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:46551
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.126.keytab
--principal=oryx/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:46551
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:17.483212 2538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:17.483541 2538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:17.483621 2538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:17.487447 2538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:17.487528 2538 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 22:38:17.487561 2538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:17.487603 2538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:17.487643 2538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:17.487679 2538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:17.492935 2538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:46551
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.126.keytab
--principal=oryx/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:46551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:17.493999 2538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:17.495039 2538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:17.503700 2543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:17.503683 2546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:17.503734 2544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:17.503925 2538 server_base.cc:1034] running on GCE node
I20260807 22:38:17.504679 2538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:17.505774 2538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:17.506978 2538 hybrid_clock.cc:648] HybridClock initialized: now 1786142297506971 us; error 30 us; skew 500 ppm
Aug 07 22:38:17 dist-test-slave-8w9v krb5kdc[2524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142297, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:17.509857 2538 init.cc:377] Logged in from keytab as oryx/127.26.52.126@KRBTEST.COM (short username oryx)
I20260807 22:38:17.510764 2538 webserver.cc:460] Webserver started at http://127.26.52.126:38307/ using document root <none> and password file <none>
I20260807 22:38:17.511345 2538 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:17.511438 2538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:17.511678 2538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:17.513756 2538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "3ad89665f69640bcbbde6cfeb2de162b"
format_stamp: "Formatted at 2026-08-07 22:38:17 on dist-test-slave-8w9v"
server_key: "b822931abc590de3520063b65c7ac11e"
server_key_iv: "9eee2dbd0101ef91391577c1f64227e2"
server_key_version: "encryptionkey@0"
I20260807 22:38:17.514343 2538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "3ad89665f69640bcbbde6cfeb2de162b"
format_stamp: "Formatted at 2026-08-07 22:38:17 on dist-test-slave-8w9v"
server_key: "b822931abc590de3520063b65c7ac11e"
server_key_iv: "9eee2dbd0101ef91391577c1f64227e2"
server_key_version: "encryptionkey@0"
I20260807 22:38:17.518388 2538 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:38:17.520746 2553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:17.521981 2538 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:17.522132 2538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "3ad89665f69640bcbbde6cfeb2de162b"
format_stamp: "Formatted at 2026-08-07 22:38:17 on dist-test-slave-8w9v"
server_key: "b822931abc590de3520063b65c7ac11e"
server_key_iv: "9eee2dbd0101ef91391577c1f64227e2"
server_key_version: "encryptionkey@0"
I20260807 22:38:17.522246 2538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:17.534636 2538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:17.538050 2538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:17.538277 2538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:17.546144 2538 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:46551
I20260807 22:38:17.546171 2618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:46551 every 8 connection(s)
I20260807 22:38:17.547061 2538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:17.549697 2619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:17.554987 2619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b: Bootstrap starting.
I20260807 22:38:17.555738 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 2538
I20260807 22:38:17.555868 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:17.556236 26833 external_mini_cluster.cc:1428] Setting key 9208b930967327c9782a499c7650eb34
I20260807 22:38:17.557840 2619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:17.558720 2619 log.cc:824] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:17.560945 2619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b: No bootstrap required, opened a new log
I20260807 22:38:17.565169 2619 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad89665f69640bcbbde6cfeb2de162b" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46551 } }
I20260807 22:38:17.565474 2619 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Aug 07 22:38:17 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:17.565547 2619 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad89665f69640bcbbde6cfeb2de162b, State: Initialized, Role: FOLLOWER
I20260807 22:38:17.565984 2619 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad89665f69640bcbbde6cfeb2de162b" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46551 } }
I20260807 22:38:17.566154 2619 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:17.566223 2619 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:17.566325 2619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:17.567540 2619 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad89665f69640bcbbde6cfeb2de162b" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46551 } }
I20260807 22:38:17.567893 2619 leader_election.cc:302] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ad89665f69640bcbbde6cfeb2de162b; no voters:
I20260807 22:38:17.568269 2619 leader_election.cc:288] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:17.568406 2624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:17.568645 2624 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [term 1 LEADER]: Becoming Leader. State: Replica: 3ad89665f69640bcbbde6cfeb2de162b, State: Running, Role: LEADER
I20260807 22:38:17.569041 2624 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad89665f69640bcbbde6cfeb2de162b" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46551 } }
I20260807 22:38:17.569653 2619 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:17.570655 2625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ad89665f69640bcbbde6cfeb2de162b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad89665f69640bcbbde6cfeb2de162b" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46551 } } }
I20260807 22:38:17.570796 2625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:17.571126 2626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ad89665f69640bcbbde6cfeb2de162b. Latest consensus state: current_term: 1 leader_uuid: "3ad89665f69640bcbbde6cfeb2de162b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad89665f69640bcbbde6cfeb2de162b" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46551 } } }
I20260807 22:38:17.571237 2626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:17.571539 2633 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:17.571756 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:17.557352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49046 (local address 127.26.52.126:46551)
0807 22:38:17.557845 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:17.557865 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:17.557909 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:38:17.558760 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:17.558784 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:17.559200 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:17.559493 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:17.560276 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:17.561703 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:17.562555 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:17.563274 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:17.563446 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:17.566165 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:17.566174 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:17.566191 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:17.566226 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:17.568236 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:17.568852 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:17.568858 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:17.568864 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:17.569039 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:17.569375 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:17.569378 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:17.569380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:17.569893 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:17.570100 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:17.570434 (+ 334us) server_negotiation.cc:299] Negotiation successful
0807 22:38:17.570744 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":148,"threads_started":1}
I20260807 22:38:17.574673 2633 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:17.580109 2633 catalog_manager.cc:1347] Generated new cluster ID: b1c7abcf5a3646469182be61ced5b1b9
I20260807 22:38:17.580195 2633 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:17.606606 2633 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:17.607944 2633 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:17.614630 2633 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b: Generated new TSK 0
I20260807 22:38:17.615404 2633 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab.
Entry for principal oryx/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab.
I20260807 22:38:17.651435 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46551
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab
--principal=oryx/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:17.769698 2645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:17.770026 2645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:17.770135 2645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:17.774320 2645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:17.774403 2645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:17.774468 2645 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:38:17.774549 2645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:17.779861 2645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab
--principal=oryx/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.52.126:46551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:17.781011 2645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:17.782196 2645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:17.791970 2651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:17.791987 2650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:17.792085 2653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:17.792240 2645 server_base.cc:1034] running on GCE node
I20260807 22:38:17.792786 2645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:17.793443 2645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:17.794633 2645 hybrid_clock.cc:648] HybridClock initialized: now 1786142297794607 us; error 40 us; skew 500 ppm
Aug 07 22:38:17 dist-test-slave-8w9v krb5kdc[2524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142297, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:17.797504 2645 init.cc:377] Logged in from keytab as oryx/127.26.52.65@KRBTEST.COM (short username oryx)
I20260807 22:38:17.798358 2645 webserver.cc:460] Webserver started at http://127.26.52.65:46523/ using document root <none> and password file <none>
I20260807 22:38:17.798956 2645 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:17.799044 2645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:17.799274 2645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:17.801299 2645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "457efe24ce774de3b43f4fb61319e4f4"
format_stamp: "Formatted at 2026-08-07 22:38:17 on dist-test-slave-8w9v"
server_key: "434df4840ededc419a15f9a5dbc50e62"
server_key_iv: "deb65e745d3be0801b648f35cf58f190"
server_key_version: "encryptionkey@0"
I20260807 22:38:17.801851 2645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "457efe24ce774de3b43f4fb61319e4f4"
format_stamp: "Formatted at 2026-08-07 22:38:17 on dist-test-slave-8w9v"
server_key: "434df4840ededc419a15f9a5dbc50e62"
server_key_iv: "deb65e745d3be0801b648f35cf58f190"
server_key_version: "encryptionkey@0"
I20260807 22:38:17.805539 2645 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:38:17.807866 2661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:17.809082 2645 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:17.809218 2645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "457efe24ce774de3b43f4fb61319e4f4"
format_stamp: "Formatted at 2026-08-07 22:38:17 on dist-test-slave-8w9v"
server_key: "434df4840ededc419a15f9a5dbc50e62"
server_key_iv: "deb65e745d3be0801b648f35cf58f190"
server_key_version: "encryptionkey@0"
I20260807 22:38:17.809329 2645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:17.843142 2645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:17.846671 2645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:17.846889 2645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:17.848410 2645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:17.848489 2645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:17.848577 2645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:17.848621 2645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:38:17 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142297, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:17.860024 2645 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:40027
I20260807 22:38:17.860134 2781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:40027 every 8 connection(s)
I20260807 22:38:17.860947 2645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:17.862620 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:17.849261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:37651 (local address 127.26.52.126:46551)
0807 22:38:17.849434 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:17.849440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:17.850291 (+ 851us) server_negotiation.cc:407] Connection header received
0807 22:38:17.851600 (+ 1309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:17.851607 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:17.851681 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:17.851749 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:17.853650 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:17.854261 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:17.855403 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:17.855659 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:17.855781 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:17.858897 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:17.858901 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:17.858906 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:17.858936 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:17.860530 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:17.861042 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:17.861048 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:17.861050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:17.861126 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:17.861510 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:17.861514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:17.861515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:17.861734 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:17.861845 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:17.862322 (+ 477us) server_negotiation.cc:299] Negotiation successful
0807 22:38:17.862448 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 22:38:17.863380 2671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:17.849621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46551 (local address 127.26.52.65:37651)
0807 22:38:17.850102 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:17.850160 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:17.851336 (+ 1176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:17.852238 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:17.852249 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:17.852749 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:17.853462 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:17.853485 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:17.854402 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:17.854405 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:17.855271 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:17.855281 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:17.855865 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:17.855870 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:17.856171 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:17.856853 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:17.856872 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:17.858735 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:17.860650 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:17.860656 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:17.860669 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:17.860930 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:17.861221 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:17.861225 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:17.861227 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:17.861388 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:17.861855 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:17.861864 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:17.862091 (+ 227us) client_negotiation.cc:769] Sending connection context
0807 22:38:17.862278 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 22:38:17.862584 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":96,"threads_started":1}
I20260807 22:38:17.864588 2782 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46551
I20260807 22:38:17.864724 2782 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:17.865260 2782 heartbeater.cc:511] Master 127.26.52.126:46551 requested a full tablet report, sending...
I20260807 22:38:17.866879 2569 ts_manager.cc:194] Registered new tserver with Master: 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65:40027)
I20260807 22:38:17.868383 2569 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:37651
I20260807 22:38:17.869138 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 2645
I20260807 22:38:17.869290 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:38:17.869653 26833 external_mini_cluster.cc:1428] Setting key 6967deae24f4f66bb03fd38ff1ef2448
I20260807 22:38:17.874509 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:17.866910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:49369 (local address 127.26.52.126:46551)
0807 22:38:17.867028 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:17.867032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:17.867287 (+ 255us) server_negotiation.cc:407] Connection header received
0807 22:38:17.867401 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:17.867403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:17.867444 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:17.867501 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:17.867969 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:17.868524 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:17.869602 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:17.869923 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:17.870037 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:17.871460 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:17.871464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:17.871467 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:17.871490 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:17.872919 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:17.873340 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:17.873345 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:17.873347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:17.873432 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:17.873708 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:17.873713 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:17.873714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:17.873880 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:17.873990 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:17.874244 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 22:38:17.874349 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:38:17.874521 2788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:17.866833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46551 (local address 127.26.52.65:49369)
0807 22:38:17.867204 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:17.867218 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:17.867311 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:17.867544 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:17.867546 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:17.867747 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:17.867861 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:17.867869 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:17.868635 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:17.868639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:17.869483 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:17.869492 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:17.870239 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:17.870245 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:17.870314 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:17.870890 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:17.870903 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:17.871323 (+ 420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:17.873034 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:17.873040 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:17.873042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:17.873239 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:17.873525 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:17.873529 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:17.873531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:17.873617 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:17.873981 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:17.873984 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:17.874081 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 22:38:17.874191 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 22:38:17.874329 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for oryx/127.26.52.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab.
Entry for principal oryx/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab.
I20260807 22:38:17.899602 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46551
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab
--principal=oryx/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:18.012080 2791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:18.012476 2791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:18.012552 2791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:18.016582 2791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:18.016633 2791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:18.016671 2791 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:38:18.016703 2791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:18.021776 2791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab
--principal=oryx/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.52.126:46551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:18.022751 2791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:18.023707 2791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:18.033499 2797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:18.033505 2796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:18.033517 2800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:18.033668 2791 server_base.cc:1034] running on GCE node
I20260807 22:38:18.034179 2791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:18.034821 2791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:18.036036 2791 hybrid_clock.cc:648] HybridClock initialized: now 1786142298036021 us; error 27 us; skew 500 ppm
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142298, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:18.038900 2791 init.cc:377] Logged in from keytab as oryx/127.26.52.66@KRBTEST.COM (short username oryx)
I20260807 22:38:18.039728 2791 webserver.cc:460] Webserver started at http://127.26.52.66:45303/ using document root <none> and password file <none>
I20260807 22:38:18.040488 2791 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:18.040557 2791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:18.040812 2791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:18.042840 2791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "d7b97dedb59f45e3add7a4363e2b7f02"
format_stamp: "Formatted at 2026-08-07 22:38:18 on dist-test-slave-8w9v"
server_key: "15f18d53bf9ecc25e43b39b2c69f87a9"
server_key_iv: "0d7a6c33d82e0119e5c6168b8a9dbd7e"
server_key_version: "encryptionkey@0"
I20260807 22:38:18.043412 2791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "d7b97dedb59f45e3add7a4363e2b7f02"
format_stamp: "Formatted at 2026-08-07 22:38:18 on dist-test-slave-8w9v"
server_key: "15f18d53bf9ecc25e43b39b2c69f87a9"
server_key_iv: "0d7a6c33d82e0119e5c6168b8a9dbd7e"
server_key_version: "encryptionkey@0"
I20260807 22:38:18.047071 2791 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:38:18.049453 2807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:18.050618 2791 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:38:18.050740 2791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "d7b97dedb59f45e3add7a4363e2b7f02"
format_stamp: "Formatted at 2026-08-07 22:38:18 on dist-test-slave-8w9v"
server_key: "15f18d53bf9ecc25e43b39b2c69f87a9"
server_key_iv: "0d7a6c33d82e0119e5c6168b8a9dbd7e"
server_key_version: "encryptionkey@0"
I20260807 22:38:18.050839 2791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:18.061614 2791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:18.064365 2791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:18.064553 2791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:18.065985 2791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:18.066039 2791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:18.066105 2791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:18.066145 2791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142298, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:18.078579 2791 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:44881
I20260807 22:38:18.078706 2929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:44881 every 8 connection(s)
I20260807 22:38:18.079557 2791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:18.081184 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.066845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:38495 (local address 127.26.52.126:46551)
0807 22:38:18.067017 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.067025 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.067907 (+ 882us) server_negotiation.cc:407] Connection header received
0807 22:38:18.068803 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.068807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.068881 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.068995 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:18.070769 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.071645 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.073509 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.073891 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.074023 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.077398 (+ 3375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:18.077402 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:18.077404 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:18.077434 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:18.079056 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.079564 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.079568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.079570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.079673 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.080005 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.080010 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.080012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.080268 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:18.080369 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.080959 (+ 590us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.081064 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:38:18.082002 2817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.067197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46551 (local address 127.26.52.66:38495)
0807 22:38:18.067642 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.067689 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.068592 (+ 903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.069353 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.069364 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.069890 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:18.070594 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.070615 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.071775 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.071780 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.073324 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.073338 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.074265 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.074271 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.074508 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.075203 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:18.075236 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:18.077227 (+ 1991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:18.079173 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:18.079179 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:18.079193 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:18.079453 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:18.079755 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:18.079759 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:18.079761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:18.079900 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:18.080390 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:18.080397 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:18.080692 (+ 295us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.080889 (+ 197us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.081138 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":140,"threads_started":1}
I20260807 22:38:18.083401 2930 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46551
I20260807 22:38:18.083587 2930 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:18.084183 2930 heartbeater.cc:511] Master 127.26.52.126:46551 requested a full tablet report, sending...
I20260807 22:38:18.085266 2569 ts_manager.cc:194] Registered new tserver with Master: d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881)
I20260807 22:38:18.085935 2569 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:38495
I20260807 22:38:18.086980 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 2791
I20260807 22:38:18.087134 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:38:18.087494 26833 external_mini_cluster.cc:1428] Setting key 3fdba77995b4e60fce111398ecb5ad83
I20260807 22:38:18.095201 2936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.085458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46551 (local address 127.26.52.66:56893)
0807 22:38:18.086381 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.086395 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.086481 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.087954 (+ 1473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.087958 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.088221 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:18.088348 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.088355 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.089242 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.089247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.090202 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.090218 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.090639 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.090646 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.090777 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.091343 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:18.091354 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:18.091668 (+ 314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:18.093646 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:18.093648 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:18.093650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:18.093824 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:18.094166 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:18.094169 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:18.094172 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:18.094277 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:18.094784 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:18.094786 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:18.094858 (+ 72us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.094939 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.095041 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":822,"thread_start_us":98,"threads_started":1}
I20260807 22:38:18.095403 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.085514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:56893 (local address 127.26.52.126:46551)
0807 22:38:18.085643 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.085650 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.086470 (+ 820us) server_negotiation.cc:407] Connection header received
0807 22:38:18.086599 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.086601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.086638 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.086695 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:18.088471 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.089095 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.090322 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.090528 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.090601 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.091810 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:18.091815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:18.091819 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:18.091849 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:18.093527 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.093934 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.093941 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.093945 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.094042 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.094378 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.094384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.094387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.094683 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:18.094793 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.095036 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.095179 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
WARNING: no policy specified for oryx/127.26.52.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab.
Entry for principal oryx/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab.
I20260807 22:38:18.117295 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46551
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab
--principal=oryx/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:42613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:18.230304 2939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:18.230561 2939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:18.230602 2939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:18.234534 2939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:18.234591 2939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:18.234658 2939 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:38:18.234741 2939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:18.240070 2939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:42613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab
--principal=oryx/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.52.126:46551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:18.241137 2939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:18.242143 2939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:18.251845 2947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:18.251866 2944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:18.251854 2945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:18.252161 2939 server_base.cc:1034] running on GCE node
I20260807 22:38:18.252612 2939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:18.253229 2939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:18.254410 2939 hybrid_clock.cc:648] HybridClock initialized: now 1786142298254400 us; error 28 us; skew 500 ppm
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142298, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:18.257231 2939 init.cc:377] Logged in from keytab as oryx/127.26.52.67@KRBTEST.COM (short username oryx)
I20260807 22:38:18.258118 2939 webserver.cc:460] Webserver started at http://127.26.52.67:42553/ using document root <none> and password file <none>
I20260807 22:38:18.258695 2939 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:18.258788 2939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:18.259035 2939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:18.261225 2939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "1c197b1f1f3b49a2ab25e11920a35881"
format_stamp: "Formatted at 2026-08-07 22:38:18 on dist-test-slave-8w9v"
server_key: "0464f2d4c31e4a591e1459556199eead"
server_key_iv: "52bcf297aee803e828c955e9ac5b8e29"
server_key_version: "encryptionkey@0"
I20260807 22:38:18.261858 2939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "1c197b1f1f3b49a2ab25e11920a35881"
format_stamp: "Formatted at 2026-08-07 22:38:18 on dist-test-slave-8w9v"
server_key: "0464f2d4c31e4a591e1459556199eead"
server_key_iv: "52bcf297aee803e828c955e9ac5b8e29"
server_key_version: "encryptionkey@0"
I20260807 22:38:18.265751 2939 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:38:18.268203 2954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:18.269436 2939 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:18.269569 2939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "1c197b1f1f3b49a2ab25e11920a35881"
format_stamp: "Formatted at 2026-08-07 22:38:18 on dist-test-slave-8w9v"
server_key: "0464f2d4c31e4a591e1459556199eead"
server_key_iv: "52bcf297aee803e828c955e9ac5b8e29"
server_key_version: "encryptionkey@0"
I20260807 22:38:18.269693 2939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:18.280920 2939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:18.283540 2939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:18.283747 2939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:18.285342 2939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:18.285424 2939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:18.285476 2939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:18.285506 2939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142298, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:18.296957 2939 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:34105
I20260807 22:38:18.297035 3073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:34105 every 8 connection(s)
I20260807 22:38:18.298064 2939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:38:18.299787 2963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.286401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46551 (local address 127.26.52.67:53041)
0807 22:38:18.286876 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.286916 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.287821 (+ 905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.288444 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.288453 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.288894 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:18.289356 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.289368 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.290356 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.290360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.291743 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.291753 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.292407 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.292412 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.292640 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.293308 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:18.293345 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:18.295039 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:18.297014 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:18.297026 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:18.297039 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:18.297371 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:18.297686 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:18.297689 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:18.297690 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:18.297818 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:18.298308 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:18.298312 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:18.298588 (+ 276us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.298775 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.299058 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":138,"threads_started":1}
I20260807 22:38:18.300338 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.285934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:53041 (local address 127.26.52.126:46551)
0807 22:38:18.286066 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.286070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.287017 (+ 947us) server_negotiation.cc:407] Connection header received
0807 22:38:18.288039 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.288042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.288115 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.288251 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:18.289508 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.290236 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.291863 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.292253 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.292362 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.295213 (+ 2851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:18.295217 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:18.295220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:18.295246 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:18.296885 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.297477 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.297480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.297482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.297580 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.297914 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.297918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.297919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.298206 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:18.298300 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.300075 (+ 1775us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.300228 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:38:18.301391 3076 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46551
I20260807 22:38:18.301527 3076 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:18.302059 3076 heartbeater.cc:511] Master 127.26.52.126:46551 requested a full tablet report, sending...
I20260807 22:38:18.303153 2570 ts_manager.cc:194] Registered new tserver with Master: 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105)
I20260807 22:38:18.303944 2570 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:53041
I20260807 22:38:18.304080 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 2939
I20260807 22:38:18.304247 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:38:18.304641 26833 external_mini_cluster.cc:1428] Setting key 2e4ed8fee9346073343e737f4bb3c487
I20260807 22:38:18.307739 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:38:18.311738 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.303668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:38533 (local address 127.26.52.126:46551)
0807 22:38:18.303778 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.303782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.304041 (+ 259us) server_negotiation.cc:407] Connection header received
0807 22:38:18.304643 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.304646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.304700 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.304760 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:18.305367 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.306093 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.307134 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.307441 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.307548 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.308665 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:18.308669 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:18.308672 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:18.308696 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:18.310064 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.310487 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.310492 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.310494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.310579 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.310929 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.310933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.310935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.311110 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:18.311220 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.311480 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.311588 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:38:18.311753 3082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.303587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46551 (local address 127.26.52.67:38533)
0807 22:38:18.303957 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.303973 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.304110 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.304900 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.304903 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.305089 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:18.305229 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.305236 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.306213 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.306216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.307007 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.307015 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.307553 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.307557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.307655 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.308207 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:18.308218 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:18.308521 (+ 303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:18.310178 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:18.310183 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:18.310185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:18.310386 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:18.310674 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:18.310678 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:18.310680 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:18.310830 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:18.311211 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:18.311214 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:18.311308 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.311425 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.311573 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":98,"threads_started":1}
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142298, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:38:18.333132 2622 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:18.326716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49048 (local address 127.26.52.126:46551)
0807 22:38:18.326865 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.326876 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.326889 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:38:18.326936 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.326939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.326977 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.327081 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:18.327796 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.328400 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.329248 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.329468 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.329575 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.332949 (+ 3374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49048: BlockingRecv error: recv got EOF from 127.0.0.1:49048 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142298, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:18.342064 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.334518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49062 (local address 127.26.52.126:46551)
0807 22:38:18.334644 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.334648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.334758 (+ 110us) server_negotiation.cc:407] Connection header received
0807 22:38:18.334912 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.334915 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.334962 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.335044 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:18.335619 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.336116 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.336944 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.337154 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.337259 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.339473 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:18.339476 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:18.339478 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:18.339501 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:18.340750 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.341119 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.341122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.341123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.341192 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.341417 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.341419 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.341420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.341575 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:18.341672 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.341860 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.341953 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:38:18.344762 2570 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49062:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:38:18.347844 2570 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:38:18.362361 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.356492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:44881 (local address 127.0.0.1:36438)
0807 22:38:18.356865 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.356877 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.356960 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.358388 (+ 1428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.358391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.358408 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:18.358488 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.358493 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.359499 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.359502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.360933 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.360943 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.361742 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.361746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.361866 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.361981 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.362100 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.362226 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":215,"thread_start_us":91,"threads_started":1}
I20260807 22:38:18.362372 3106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.357609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36438 (local address 127.26.52.66:44881)
0807 22:38:18.357943 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.357955 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.357974 (+ 19us) server_negotiation.cc:407] Connection header received
0807 22:38:18.358041 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.358045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.358221 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.358410 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:18.358605 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.359360 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.361066 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.361599 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.361864 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.362021 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.362129 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.362227 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":103,"threads_started":1}
I20260807 22:38:18.363059 3101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.356045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40027 (local address 127.0.0.1:44168)
0807 22:38:18.356455 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.356508 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.356632 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.357633 (+ 1001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.357639 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.357661 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:18.357796 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.357804 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.359304 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.359307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.360860 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.360871 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.361886 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.361891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.362758 (+ 867us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.362790 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.362863 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.362961 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":821,"thread_start_us":141,"threads_started":1}
I20260807 22:38:18.363299 3102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.356266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44168 (local address 127.26.52.65:40027)
0807 22:38:18.357213 (+ 947us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.357230 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.357254 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:38:18.357328 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.357332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.357486 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.357643 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:18.357943 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.359168 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.361011 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.361746 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.361982 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.362135 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.362916 (+ 781us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.363038 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":83,"threads_started":1}
I20260807 22:38:18.363533 3104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.356778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:34105 (local address 127.0.0.1:51142)
0807 22:38:18.357005 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.357019 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.357099 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.357962 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.357966 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.357984 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:18.358064 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.358069 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.359374 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.359377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.360643 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.360653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.361717 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.361723 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.363223 (+ 1500us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.363244 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.363311 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.363411 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":161,"thread_start_us":98,"threads_started":1}
I20260807 22:38:18.364193 3105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.357212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51142 (local address 127.26.52.67:34105)
0807 22:38:18.357536 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.357554 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.357576 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:38:18.357649 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.357654 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.357837 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.357993 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:18.358148 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.359247 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.360769 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.361581 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.361696 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.361875 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.363727 (+ 1852us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.364038 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":128,"threads_started":1}
I20260807 22:38:18.365801 2859 tablet_service.cc:1467] Processing CreateTablet for tablet 4b6234d1fd1a46878989e90e5190895d (DEFAULT_TABLE table=test-table [id=bce74ce418214172b680f5d987b196e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:18.365902 2713 tablet_service.cc:1467] Processing CreateTablet for tablet 4b6234d1fd1a46878989e90e5190895d (DEFAULT_TABLE table=test-table [id=bce74ce418214172b680f5d987b196e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:18.366752 2859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b6234d1fd1a46878989e90e5190895d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:18.366894 2713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b6234d1fd1a46878989e90e5190895d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:18.366591 3006 tablet_service.cc:1467] Processing CreateTablet for tablet 4b6234d1fd1a46878989e90e5190895d (DEFAULT_TABLE table=test-table [id=bce74ce418214172b680f5d987b196e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:18.367470 3006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b6234d1fd1a46878989e90e5190895d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:18.374053 3107 tablet_bootstrap.cc:492] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: Bootstrap starting.
I20260807 22:38:18.375216 3109 tablet_bootstrap.cc:492] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: Bootstrap starting.
I20260807 22:38:18.375469 3108 tablet_bootstrap.cc:492] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: Bootstrap starting.
I20260807 22:38:18.377018 3107 tablet_bootstrap.cc:654] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:18.377311 3109 tablet_bootstrap.cc:654] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:18.377692 3108 tablet_bootstrap.cc:654] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:18.378086 3109 log.cc:824] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:18.378229 3107 log.cc:824] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:18.378449 3108 log.cc:824] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:18.380275 3109 tablet_bootstrap.cc:492] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: No bootstrap required, opened a new log
I20260807 22:38:18.380497 3109 ts_tablet_manager.cc:1397] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260807 22:38:18.380504 3107 tablet_bootstrap.cc:492] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: No bootstrap required, opened a new log
I20260807 22:38:18.380694 3107 ts_tablet_manager.cc:1397] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260807 22:38:18.380777 3108 tablet_bootstrap.cc:492] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: No bootstrap required, opened a new log
I20260807 22:38:18.380947 3108 ts_tablet_manager.cc:1397] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 22:38:18.384568 3109 raft_consensus.cc:348] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } }
I20260807 22:38:18.384826 3109 raft_consensus.cc:374] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:18.384881 3109 raft_consensus.cc:729] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c197b1f1f3b49a2ab25e11920a35881, State: Initialized, Role: FOLLOWER
I20260807 22:38:18.384838 3108 raft_consensus.cc:348] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } }
I20260807 22:38:18.385085 3108 raft_consensus.cc:374] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:18.385143 3108 raft_consensus.cc:729] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457efe24ce774de3b43f4fb61319e4f4, State: Initialized, Role: FOLLOWER
I20260807 22:38:18.385027 3107 raft_consensus.cc:348] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } }
I20260807 22:38:18.385253 3107 raft_consensus.cc:374] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:18.385308 3107 raft_consensus.cc:729] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b97dedb59f45e3add7a4363e2b7f02, State: Initialized, Role: FOLLOWER
I20260807 22:38:18.385488 3109 consensus_queue.cc:260] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } }
I20260807 22:38:18.385576 3108 consensus_queue.cc:260] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } }
I20260807 22:38:18.385648 3107 consensus_queue.cc:260] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } }
I20260807 22:38:18.386595 3107 ts_tablet_manager.cc:1428] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 22:38:18.386595 3108 ts_tablet_manager.cc:1428] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260807 22:38:18.386596 3109 ts_tablet_manager.cc:1428] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:38:18.386969 3076 heartbeater.cc:503] Master 127.26.52.126:46551 was elected leader, sending a full tablet report...
I20260807 22:38:18.386968 2930 heartbeater.cc:503] Master 127.26.52.126:46551 was elected leader, sending a full tablet report...
I20260807 22:38:18.387952 2782 heartbeater.cc:503] Master 127.26.52.126:46551 was elected leader, sending a full tablet report...
I20260807 22:38:18.397954 3114 raft_consensus.cc:482] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:18.398103 3114 raft_consensus.cc:504] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } }
I20260807 22:38:18.399139 3114 leader_election.cc:288] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105), d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881)
I20260807 22:38:18.404547 3106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.399505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:44129 (local address 127.26.52.66:44881)
0807 22:38:18.399624 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.399629 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.399788 (+ 159us) server_negotiation.cc:407] Connection header received
0807 22:38:18.399917 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.399920 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.399968 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.400044 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:18.400504 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.401301 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.403174 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.403796 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.403923 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.403975 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.404316 (+ 341us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.404397 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:38:18.404609 3116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.399319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:34105 (local address 127.26.52.65:53509)
0807 22:38:18.399684 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.399699 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.399823 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.400072 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.400074 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.400110 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:18.400377 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.400384 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.401442 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.401445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.403039 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.403051 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.403925 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.403928 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.404103 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.404198 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.404278 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.404428 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":258,"spinlock_wait_cycles":16896,"thread_start_us":127,"threads_started":1}
I20260807 22:38:18.404683 3105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.399441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:53509 (local address 127.26.52.67:34105)
0807 22:38:18.399567 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.399573 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.399791 (+ 218us) server_negotiation.cc:407] Connection header received
0807 22:38:18.399925 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.399928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.399968 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.400044 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:18.400504 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.401301 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.403174 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.403795 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.403933 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.403976 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.404492 (+ 516us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.404567 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:38:18.405234 3117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.399417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:44881 (local address 127.26.52.65:44129)
0807 22:38:18.399689 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.399702 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.399815 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.400072 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.400074 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.400109 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:18.400378 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.400384 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.401442 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.401445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.403040 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.403051 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.403924 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.403928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.404109 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.404198 (+ 89us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.404279 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.404428 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":362,"spinlock_wait_cycles":18688,"thread_start_us":98,"threads_started":1}
I20260807 22:38:18.405243 3027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6234d1fd1a46878989e90e5190895d" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c197b1f1f3b49a2ab25e11920a35881" is_pre_election: true
I20260807 22:38:18.405584 3027 raft_consensus.cc:2454] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 0.
I20260807 22:38:18.405827 2879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6234d1fd1a46878989e90e5190895d" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" is_pre_election: true
I20260807 22:38:18.406113 2879 raft_consensus.cc:2454] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 0.
I20260807 22:38:18.406117 2666 leader_election.cc:302] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c197b1f1f3b49a2ab25e11920a35881, 457efe24ce774de3b43f4fb61319e4f4; no voters:
I20260807 22:38:18.406396 3114 raft_consensus.cc:2781] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:38:18.406483 3114 raft_consensus.cc:482] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:18.406517 3114 raft_consensus.cc:3037] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:18.407554 3114 raft_consensus.cc:504] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } }
I20260807 22:38:18.407938 3114 leader_election.cc:288] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 election: Requested vote from peers 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105), d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881)
I20260807 22:38:18.408219 3027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6234d1fd1a46878989e90e5190895d" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c197b1f1f3b49a2ab25e11920a35881"
I20260807 22:38:18.408370 2879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b6234d1fd1a46878989e90e5190895d" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b97dedb59f45e3add7a4363e2b7f02"
I20260807 22:38:18.408401 3027 raft_consensus.cc:3037] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:18.408507 2879 raft_consensus.cc:3037] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:18.409354 3027 raft_consensus.cc:2454] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 1.
I20260807 22:38:18.409624 2879 raft_consensus.cc:2454] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 1.
I20260807 22:38:18.409644 2666 leader_election.cc:302] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c197b1f1f3b49a2ab25e11920a35881, 457efe24ce774de3b43f4fb61319e4f4; no voters:
I20260807 22:38:18.409852 3114 raft_consensus.cc:2781] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:18.410090 3114 raft_consensus.cc:686] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 1 LEADER]: Becoming Leader. State: Replica: 457efe24ce774de3b43f4fb61319e4f4, State: Running, Role: LEADER
I20260807 22:38:18.410415 3114 consensus_queue.cc:237] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } }
I20260807 22:38:18.413682 2568 catalog_manager.cc:5495] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65). New cstate: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } health_report { overall_health: UNKNOWN } } }
I20260807 22:38:18.425413 3102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.421744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44176 (local address 127.26.52.65:40027)
0807 22:38:18.421885 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.421890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.421904 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:38:18.422078 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.422081 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.422132 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.422242 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:18.422479 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.423039 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.423890 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.424218 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.424325 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.424627 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:18.425038 (+ 411us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:18.425166 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.425222 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.425275 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:38:18.431123 3027 raft_consensus.cc:1261] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Refusing update from remote peer 457efe24ce774de3b43f4fb61319e4f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:18.431123 2879 raft_consensus.cc:1261] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Refusing update from remote peer 457efe24ce774de3b43f4fb61319e4f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:18.431831 3118 consensus_queue.cc:1035] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:18.432010 3114 consensus_queue.cc:1035] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:18.439535 3121 mvcc.cc:205] Tried to move back new op lower bound from 7316038854366781440 to 7316038854291525632. Current Snapshot: MvccSnapshot[applied={T|T < 7316038854366781440}]
I20260807 22:38:18.441825 3124 mvcc.cc:205] Tried to move back new op lower bound from 7316038854366781440 to 7316038854291525632. Current Snapshot: MvccSnapshot[applied={T|T < 7316038854366781440}]
I20260807 22:38:18.442041 3123 mvcc.cc:205] Tried to move back new op lower bound from 7316038854366781440 to 7316038854291525632. Current Snapshot: MvccSnapshot[applied={T|T < 7316038854366781440}]
I20260807 22:38:18.449697 2568 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:18.449882 2568 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:18.452322 2568 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b: Sending DeleteTablet for 3 replicas of tablet 4b6234d1fd1a46878989e90e5190895d
I20260807 22:38:18.453078 2859 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6234d1fd1a46878989e90e5190895d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:18 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:36438
I20260807 22:38:18.453115 3006 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6234d1fd1a46878989e90e5190895d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:18 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:51142
I20260807 22:38:18.453576 3131 tablet_replica.cc:330] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: stopping tablet replica
I20260807 22:38:18.453593 2568 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49062:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 22:38:18.453851 2713 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b6234d1fd1a46878989e90e5190895d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:18 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:44168
I20260807 22:38:18.453948 3131 raft_consensus.cc:2229] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 22:38:18.454003 2568 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:38:18.454321 3131 raft_consensus.cc:2258] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:18.454624 3133 tablet_replica.cc:330] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: stopping tablet replica
I20260807 22:38:18.454838 3132 tablet_replica.cc:330] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: stopping tablet replica
I20260807 22:38:18.455016 3133 raft_consensus.cc:2229] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:38:18.455195 3132 raft_consensus.cc:2229] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:18.455572 3133 raft_consensus.cc:2258] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:18.455578 3132 raft_consensus.cc:2258] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:18.457068 3133 ts_tablet_manager.cc:1905] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:18.457068 3132 ts_tablet_manager.cc:1905] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:18.459829 2713 tablet_service.cc:1467] Processing CreateTablet for tablet 7b3238dfa3964e1989ae2a9278315589 (DEFAULT_TABLE table=test-table [id=071d08b77c78448883d072804041fdf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:18.459935 3132 ts_tablet_manager.cc:1918] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:18.460043 3132 log.cc:1196] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/4b6234d1fd1a46878989e90e5190895d
I20260807 22:38:18.460090 2713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b3238dfa3964e1989ae2a9278315589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:18.460402 3132 ts_tablet_manager.cc:1939] T 4b6234d1fd1a46878989e90e5190895d P 1c197b1f1f3b49a2ab25e11920a35881: Deleting consensus metadata
I20260807 22:38:18.460637 3133 ts_tablet_manager.cc:1918] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:18.460781 3133 log.cc:1196] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/4b6234d1fd1a46878989e90e5190895d
I20260807 22:38:18.461172 3133 ts_tablet_manager.cc:1939] T 4b6234d1fd1a46878989e90e5190895d P 457efe24ce774de3b43f4fb61319e4f4: Deleting consensus metadata
I20260807 22:38:18.461685 2557 catalog_manager.cc:4841] TS 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105): tablet 4b6234d1fd1a46878989e90e5190895d (table test-table [id=bce74ce418214172b680f5d987b196e4]) successfully deleted
I20260807 22:38:18.462316 3108 tablet_bootstrap.cc:492] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: Bootstrap starting.
I20260807 22:38:18.462388 2557 catalog_manager.cc:4841] TS 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65:40027): tablet 4b6234d1fd1a46878989e90e5190895d (table test-table [id=bce74ce418214172b680f5d987b196e4]) successfully deleted
I20260807 22:38:18.462474 3006 tablet_service.cc:1467] Processing CreateTablet for tablet 7b3238dfa3964e1989ae2a9278315589 (DEFAULT_TABLE table=test-table [id=071d08b77c78448883d072804041fdf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:18.462723 3006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b3238dfa3964e1989ae2a9278315589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:18.462929 2859 tablet_service.cc:1467] Processing CreateTablet for tablet 7b3238dfa3964e1989ae2a9278315589 (DEFAULT_TABLE table=test-table [id=071d08b77c78448883d072804041fdf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:18.463182 2859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b3238dfa3964e1989ae2a9278315589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:18.463275 3108 tablet_bootstrap.cc:654] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:18.464438 3108 tablet_bootstrap.cc:492] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: No bootstrap required, opened a new log
I20260807 22:38:18.464550 3108 ts_tablet_manager.cc:1397] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260807 22:38:18.465065 3109 tablet_bootstrap.cc:492] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: Bootstrap starting.
I20260807 22:38:18.465014 3108 raft_consensus.cc:348] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.465116 3108 raft_consensus.cc:374] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:18.465150 3108 raft_consensus.cc:729] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457efe24ce774de3b43f4fb61319e4f4, State: Initialized, Role: FOLLOWER
I20260807 22:38:18.465273 3108 consensus_queue.cc:260] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.465507 3108 ts_tablet_manager.cc:1428] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:18.465838 3107 tablet_bootstrap.cc:492] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: Bootstrap starting.
I20260807 22:38:18.466001 3109 tablet_bootstrap.cc:654] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:18.466853 3107 tablet_bootstrap.cc:654] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:18.467849 3109 tablet_bootstrap.cc:492] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: No bootstrap required, opened a new log
I20260807 22:38:18.467944 3109 ts_tablet_manager.cc:1397] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 22:38:18.468398 3109 raft_consensus.cc:348] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.468526 3109 raft_consensus.cc:374] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:18.468567 3109 raft_consensus.cc:729] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c197b1f1f3b49a2ab25e11920a35881, State: Initialized, Role: FOLLOWER
I20260807 22:38:18.468721 3107 tablet_bootstrap.cc:492] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: No bootstrap required, opened a new log
I20260807 22:38:18.468690 3109 consensus_queue.cc:260] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.468804 3107 ts_tablet_manager.cc:1397] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 22:38:18.468938 3109 ts_tablet_manager.cc:1428] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:18.469219 3107 raft_consensus.cc:348] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.469345 3107 raft_consensus.cc:374] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:18.469383 3107 raft_consensus.cc:729] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b97dedb59f45e3add7a4363e2b7f02, State: Initialized, Role: FOLLOWER
I20260807 22:38:18.469488 3131 ts_tablet_manager.cc:1905] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:18.469511 3107 consensus_queue.cc:260] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.470086 3107 ts_tablet_manager.cc:1428] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:18.472286 3131 ts_tablet_manager.cc:1918] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:18.472477 3131 log.cc:1196] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/4b6234d1fd1a46878989e90e5190895d
I20260807 22:38:18.472888 3131 ts_tablet_manager.cc:1939] T 4b6234d1fd1a46878989e90e5190895d P d7b97dedb59f45e3add7a4363e2b7f02: Deleting consensus metadata
I20260807 22:38:18.474051 2556 catalog_manager.cc:4841] TS d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881): tablet 4b6234d1fd1a46878989e90e5190895d (table test-table [id=bce74ce418214172b680f5d987b196e4]) successfully deleted
I20260807 22:38:18.533613 3114 raft_consensus.cc:482] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:18.533780 3114 raft_consensus.cc:504] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.534220 3114 leader_election.cc:288] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881), 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105)
I20260807 22:38:18.534667 2879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b3238dfa3964e1989ae2a9278315589" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" is_pre_election: true
I20260807 22:38:18.534842 2879 raft_consensus.cc:2454] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 0.
I20260807 22:38:18.534941 3026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b3238dfa3964e1989ae2a9278315589" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c197b1f1f3b49a2ab25e11920a35881" is_pre_election: true
I20260807 22:38:18.535118 3026 raft_consensus.cc:2454] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 0.
I20260807 22:38:18.535210 2665 leader_election.cc:302] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457efe24ce774de3b43f4fb61319e4f4, d7b97dedb59f45e3add7a4363e2b7f02; no voters:
I20260807 22:38:18.535439 3114 raft_consensus.cc:2781] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:38:18.535517 3114 raft_consensus.cc:482] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:18.535573 3114 raft_consensus.cc:3037] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:18.536651 3114 raft_consensus.cc:504] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.536996 3114 leader_election.cc:288] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 election: Requested vote from peers d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881), 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105)
I20260807 22:38:18.537324 3026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b3238dfa3964e1989ae2a9278315589" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c197b1f1f3b49a2ab25e11920a35881"
I20260807 22:38:18.537325 2879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b3238dfa3964e1989ae2a9278315589" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b97dedb59f45e3add7a4363e2b7f02"
I20260807 22:38:18.537465 3026 raft_consensus.cc:3037] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:18.537465 2879 raft_consensus.cc:3037] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:18.538945 3026 raft_consensus.cc:2454] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 1.
I20260807 22:38:18.538945 2879 raft_consensus.cc:2454] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 1.
I20260807 22:38:18.539280 2665 leader_election.cc:302] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457efe24ce774de3b43f4fb61319e4f4, d7b97dedb59f45e3add7a4363e2b7f02; no voters:
I20260807 22:38:18.539466 3114 raft_consensus.cc:2781] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:18.539597 3114 raft_consensus.cc:686] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 LEADER]: Becoming Leader. State: Replica: 457efe24ce774de3b43f4fb61319e4f4, State: Running, Role: LEADER
I20260807 22:38:18.539770 3114 consensus_queue.cc:237] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.541574 2568 catalog_manager.cc:5495] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65). New cstate: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } health_report { overall_health: UNKNOWN } } }
W20260807 22:38:18.549052 3077 tablet.cc:2369] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142297, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.126@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:18.579373 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.569728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49076 (local address 127.26.52.126:46551)
0807 22:38:18.569864 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.569869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.570011 (+ 142us) server_negotiation.cc:407] Connection header received
0807 22:38:18.570159 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.570161 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.570199 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.570264 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:18.571144 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.571745 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.572937 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.573137 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.573215 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.575903 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:18.575906 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:18.575908 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:18.575936 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:18.577381 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.577978 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.577982 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.577983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.578066 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:18.578429 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:18.578432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:18.578433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:18.578605 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:18.578685 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.579059 (+ 374us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.579251 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":89,"server-negotiator.queue_time_us":49}
I20260807 22:38:18.579396 3144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.569551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46551 (local address 127.0.0.1:49076)
0807 22:38:18.569909 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.569928 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.570060 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.570321 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.570325 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.570901 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:18.571026 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.571035 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.571882 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.571886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.572788 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.572800 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.573264 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.573269 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.573358 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.574032 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:18.574048 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:18.575749 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:18.577498 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:18.577508 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:18.577514 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:18.577829 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:18.578189 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:18.578192 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:18.578194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:18.578301 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:18.578724 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:18.578731 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:18.578860 (+ 129us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.579011 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.579183 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":119,"threads_started":1}
W20260807 22:38:18.580880 2931 tablet.cc:2369] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:38:18.584012 2568 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:49076:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 22:38:18.584887 2568 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:38:18.590045 2713 tablet_service.cc:1467] Processing CreateTablet for tablet 9f88f61b1c15461cb78a4418de8da441 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e7353080dcad42d0b8dbfca0117cdf39]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:38:18.590299 2859 tablet_service.cc:1467] Processing CreateTablet for tablet 9f88f61b1c15461cb78a4418de8da441 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e7353080dcad42d0b8dbfca0117cdf39]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:38:18.590458 2713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f88f61b1c15461cb78a4418de8da441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:18.590660 2859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f88f61b1c15461cb78a4418de8da441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:18.592971 3108 tablet_bootstrap.cc:492] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: Bootstrap starting.
I20260807 22:38:18.593361 3006 tablet_service.cc:1467] Processing CreateTablet for tablet 9f88f61b1c15461cb78a4418de8da441 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e7353080dcad42d0b8dbfca0117cdf39]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:38:18.593704 3107 tablet_bootstrap.cc:492] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: Bootstrap starting.
I20260807 22:38:18.593741 3006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f88f61b1c15461cb78a4418de8da441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:18.593984 3108 tablet_bootstrap.cc:654] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:18.594667 3107 tablet_bootstrap.cc:654] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:18.596029 3107 tablet_bootstrap.cc:492] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: No bootstrap required, opened a new log
I20260807 22:38:18.596112 3107 ts_tablet_manager.cc:1397] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260807 22:38:18.596633 3107 raft_consensus.cc:348] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.596781 3107 raft_consensus.cc:374] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:18.596813 3107 raft_consensus.cc:729] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b97dedb59f45e3add7a4363e2b7f02, State: Initialized, Role: FOLLOWER
I20260807 22:38:18.596962 3109 tablet_bootstrap.cc:492] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: Bootstrap starting.
I20260807 22:38:18.596954 3107 consensus_queue.cc:260] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.597282 3115 tablet_replica.cc:439] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } }
I20260807 22:38:18.597443 3115 tablet_replica.cc:442] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:38:18.597965 3109 tablet_bootstrap.cc:654] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:18.599169 3109 tablet_bootstrap.cc:492] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: No bootstrap required, opened a new log
I20260807 22:38:18.599267 3109 ts_tablet_manager.cc:1397] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:18.599395 3107 ts_tablet_manager.cc:1428] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260807 22:38:18.599706 3109 raft_consensus.cc:348] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.599812 3109 raft_consensus.cc:374] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:18.599851 3109 raft_consensus.cc:729] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c197b1f1f3b49a2ab25e11920a35881, State: Initialized, Role: FOLLOWER
I20260807 22:38:18.599985 3109 consensus_queue.cc:260] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.600337 3109 ts_tablet_manager.cc:1428] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:38:18.600317 3113 tablet_replica.cc:439] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } }
I20260807 22:38:18.601156 3113 tablet_replica.cc:442] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:38:18.601197 3108 tablet_bootstrap.cc:492] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: No bootstrap required, opened a new log
I20260807 22:38:18.601286 3108 ts_tablet_manager.cc:1397] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260807 22:38:18.601779 3108 raft_consensus.cc:348] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.601897 3108 raft_consensus.cc:374] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:18.601933 3108 raft_consensus.cc:729] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457efe24ce774de3b43f4fb61319e4f4, State: Initialized, Role: FOLLOWER
I20260807 22:38:18.602047 3108 consensus_queue.cc:260] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.602315 3108 ts_tablet_manager.cc:1428] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:18.602566 3114 tablet_replica.cc:439] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } }
I20260807 22:38:18.602679 3114 tablet_replica.cc:442] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 22:38:18.612269 2783 tablet.cc:2369] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:38:18.852701 3114 raft_consensus.cc:482] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:18.852838 3114 raft_consensus.cc:504] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.853260 3114 leader_election.cc:288] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881), 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105)
I20260807 22:38:18.853782 2879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f88f61b1c15461cb78a4418de8da441" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" is_pre_election: true
I20260807 22:38:18.853789 3026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f88f61b1c15461cb78a4418de8da441" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c197b1f1f3b49a2ab25e11920a35881" is_pre_election: true
I20260807 22:38:18.853950 2879 raft_consensus.cc:2454] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 0.
I20260807 22:38:18.853961 3026 raft_consensus.cc:2454] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 0.
I20260807 22:38:18.854262 2666 leader_election.cc:302] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c197b1f1f3b49a2ab25e11920a35881, 457efe24ce774de3b43f4fb61319e4f4; no voters:
I20260807 22:38:18.854451 3114 raft_consensus.cc:2781] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:38:18.854518 3114 raft_consensus.cc:482] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:18.854558 3114 raft_consensus.cc:3037] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:18.855576 3114 raft_consensus.cc:504] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.855887 3114 leader_election.cc:288] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 election: Requested vote from peers d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881), 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105)
I20260807 22:38:18.856272 2879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f88f61b1c15461cb78a4418de8da441" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b97dedb59f45e3add7a4363e2b7f02"
I20260807 22:38:18.856339 3026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f88f61b1c15461cb78a4418de8da441" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c197b1f1f3b49a2ab25e11920a35881"
I20260807 22:38:18.856411 2879 raft_consensus.cc:3037] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:18.856454 3026 raft_consensus.cc:3037] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:18.857582 3026 raft_consensus.cc:2454] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 1.
I20260807 22:38:18.857582 2879 raft_consensus.cc:2454] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 1.
I20260807 22:38:18.857903 2666 leader_election.cc:302] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c197b1f1f3b49a2ab25e11920a35881, 457efe24ce774de3b43f4fb61319e4f4; no voters:
I20260807 22:38:18.858150 3114 raft_consensus.cc:2781] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:18.858224 3114 raft_consensus.cc:686] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 LEADER]: Becoming Leader. State: Replica: 457efe24ce774de3b43f4fb61319e4f4, State: Running, Role: LEADER
I20260807 22:38:18.858342 3114 consensus_queue.cc:237] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:18.858981 3118 tablet_replica.cc:439] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: TxnStatusTablet state changed. Reason: New leader 457efe24ce774de3b43f4fb61319e4f4. Latest consensus state: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } }
I20260807 22:38:18.859100 3118 tablet_replica.cc:442] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:38:18.859396 3149 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 22:38:18.859601 3149 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 22:38:18.860260 2568 catalog_manager.cc:5495] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65). New cstate: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } health_report { overall_health: UNKNOWN } } }
I20260807 22:38:18.890574 3144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.887114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40027 (local address 127.0.0.1:44180)
0807 22:38:18.887260 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.887277 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.887375 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.887659 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.887661 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.887667 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:38:18.887757 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.887760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.888780 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.888782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.889376 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.889384 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.889942 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.889945 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.890004 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.890047 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:38:18.890340 (+ 293us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:38:18.890352 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.890402 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.890463 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 22:38:18.890594 3102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.887211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44180 (local address 127.26.52.65:40027)
0807 22:38:18.887335 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.887340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.887355 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:38:18.887491 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.887494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.887549 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.887632 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:18.887854 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.888673 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.889489 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.889825 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.889936 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.890175 (+ 239us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:18.890254 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:18.890325 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.890414 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.890465 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:38:18.893157 3026 raft_consensus.cc:1261] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Refusing update from remote peer 457efe24ce774de3b43f4fb61319e4f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:18.893194 2879 raft_consensus.cc:1261] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Refusing update from remote peer 457efe24ce774de3b43f4fb61319e4f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:18.893628 3118 consensus_queue.cc:1035] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:18.893791 3114 consensus_queue.cc:1035] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:18.895220 3113 tablet_replica.cc:439] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: TxnStatusTablet state changed. Reason: New leader 457efe24ce774de3b43f4fb61319e4f4. Latest consensus state: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } }
I20260807 22:38:18.895226 3115 tablet_replica.cc:439] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: TxnStatusTablet state changed. Reason: New leader 457efe24ce774de3b43f4fb61319e4f4. Latest consensus state: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } }
I20260807 22:38:18.895331 3115 tablet_replica.cc:442] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:38:18.895334 3113 tablet_replica.cc:442] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:38:18.898173 3118 tablet_replica.cc:439] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } }
I20260807 22:38:18.898280 3114 tablet_replica.cc:439] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } }
I20260807 22:38:18.898353 3114 tablet_replica.cc:442] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:38:18.898974 3115 tablet_replica.cc:439] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } }
I20260807 22:38:18.899078 3115 tablet_replica.cc:442] T 9f88f61b1c15461cb78a4418de8da441 P d7b97dedb59f45e3add7a4363e2b7f02: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:38:18.900089 3113 tablet_replica.cc:439] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } } }
I20260807 22:38:18.900223 3113 tablet_replica.cc:442] T 9f88f61b1c15461cb78a4418de8da441 P 1c197b1f1f3b49a2ab25e11920a35881: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:38:18.898284 3118 tablet_replica.cc:442] T 9f88f61b1c15461cb78a4418de8da441 P 457efe24ce774de3b43f4fb61319e4f4: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:38:18.913066 3157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.909444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40027 (local address 127.26.52.65:55893)
0807 22:38:18.909774 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:18.909787 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:18.909869 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:18.910096 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:18.910098 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:18.910103 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:38:18.910194 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.910198 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.911125 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.911128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.911751 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:18.911759 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.912310 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.912314 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:18.912388 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.912432 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:38:18.912788 (+ 356us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:38:18.912795 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:38:18.912866 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 22:38:18.912948 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":4,"thread_start_us":95,"threads_started":1}
I20260807 22:38:18.913070 3102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.909538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:55893 (local address 127.26.52.65:40027)
0807 22:38:18.909664 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.909669 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.909850 (+ 181us) server_negotiation.cc:407] Connection header received
0807 22:38:18.909954 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.909957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.910005 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.910081 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:18.910287 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.911029 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.911867 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.912189 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.912291 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.912608 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:18.912681 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:18.912773 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:18.912870 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 22:38:18.912934 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":47}
I20260807 22:38:18.919193 2879 raft_consensus.cc:1261] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Refusing update from remote peer 457efe24ce774de3b43f4fb61319e4f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:18.919231 3026 raft_consensus.cc:1261] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Refusing update from remote peer 457efe24ce774de3b43f4fb61319e4f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:18.919533 3154 consensus_queue.cc:1035] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:18.919693 3118 consensus_queue.cc:1035] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:18.958488 2570 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:18.958658 2570 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:18.960632 2570 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b: Sending DeleteTablet for 3 replicas of tablet 7b3238dfa3964e1989ae2a9278315589
I20260807 22:38:18.961141 2712 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b3238dfa3964e1989ae2a9278315589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:18 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:44168
I20260807 22:38:18.961238 2859 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b3238dfa3964e1989ae2a9278315589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:18 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:36438
I20260807 22:38:18.961432 3133 tablet_replica.cc:330] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: stopping tablet replica
I20260807 22:38:18.961526 3006 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b3238dfa3964e1989ae2a9278315589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:18 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:51142
I20260807 22:38:18.961552 3133 raft_consensus.cc:2229] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:38:18.961701 3132 tablet_replica.cc:330] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: stopping tablet replica
I20260807 22:38:18.961719 3133 raft_consensus.cc:2258] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:18.961834 3132 raft_consensus.cc:2229] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:18.961876 3131 tablet_replica.cc:330] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: stopping tablet replica
I20260807 22:38:18.961952 3132 raft_consensus.cc:2258] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:18.961987 3131 raft_consensus.cc:2229] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:18.962090 3131 raft_consensus.cc:2258] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:18.962669 3132 ts_tablet_manager.cc:1905] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:18.962791 3133 ts_tablet_manager.cc:1905] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:18.965216 3132 ts_tablet_manager.cc:1918] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:38:18.965313 3132 log.cc:1196] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/7b3238dfa3964e1989ae2a9278315589
I20260807 22:38:18.965489 3133 ts_tablet_manager.cc:1918] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:38:18.965566 3133 log.cc:1196] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/7b3238dfa3964e1989ae2a9278315589
I20260807 22:38:18.965603 3132 ts_tablet_manager.cc:1939] T 7b3238dfa3964e1989ae2a9278315589 P 1c197b1f1f3b49a2ab25e11920a35881: Deleting consensus metadata
I20260807 22:38:18.965833 3133 ts_tablet_manager.cc:1939] T 7b3238dfa3964e1989ae2a9278315589 P 457efe24ce774de3b43f4fb61319e4f4: Deleting consensus metadata
I20260807 22:38:18.966333 2557 catalog_manager.cc:4841] TS 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105): tablet 7b3238dfa3964e1989ae2a9278315589 (table test-table [id=071d08b77c78448883d072804041fdf3]) successfully deleted
I20260807 22:38:18.966986 3131 ts_tablet_manager.cc:1905] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:18.969664 3131 ts_tablet_manager.cc:1918] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:38:18.969744 3131 log.cc:1196] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/7b3238dfa3964e1989ae2a9278315589
I20260807 22:38:18.970013 3131 ts_tablet_manager.cc:1939] T 7b3238dfa3964e1989ae2a9278315589 P d7b97dedb59f45e3add7a4363e2b7f02: Deleting consensus metadata
I20260807 22:38:18.970616 2556 catalog_manager.cc:4841] TS d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881): tablet 7b3238dfa3964e1989ae2a9278315589 (table test-table [id=071d08b77c78448883d072804041fdf3]) successfully deleted
I20260807 22:38:18.970649 2557 catalog_manager.cc:4841] TS 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65:40027): tablet 7b3238dfa3964e1989ae2a9278315589 (table test-table [id=071d08b77c78448883d072804041fdf3]) successfully deleted
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:38:18.993702 2622 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:18.987215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49092 (local address 127.26.52.126:46551)
0807 22:38:18.987368 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.987375 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.987602 (+ 227us) server_negotiation.cc:407] Connection header received
0807 22:38:18.987780 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.987782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.987827 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.987915 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:18.988689 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.989212 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.990206 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.990425 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.990531 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:18.993576 (+ 3045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49092: BlockingRecv error: recv got EOF from 127.0.0.1:49092 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 22:38:18 dist-test-slave-8w9v krb5kdc[2524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM
I20260807 22:38:19.003517 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:18.995098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49100 (local address 127.26.52.126:46551)
0807 22:38:18.995226 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:18.995230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:18.995336 (+ 106us) server_negotiation.cc:407] Connection header received
0807 22:38:18.995472 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:18.995475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:18.995525 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:18.995607 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:18.996226 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.996718 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.997502 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:18.997723 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:18.997834 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.000308 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:19.000311 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:19.000314 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:19.000337 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:19.001814 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:19.002248 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:19.002251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:19.002253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:19.002334 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:19.002692 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:19.002694 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:19.002695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:19.002862 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:19.002959 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:19.003263 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 22:38:19.003354 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:38:19.006131 2570 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:38:19.006597 2570 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:38:19.011466 2712 tablet_service.cc:1467] Processing CreateTablet for tablet c91a2708344143888ad4fdb3924527be (DEFAULT_TABLE table=test-table [id=f65e33b84bfc49a0a5c7ae54f4c3ebbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:19.011778 2712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c91a2708344143888ad4fdb3924527be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:19.011811 3006 tablet_service.cc:1467] Processing CreateTablet for tablet c91a2708344143888ad4fdb3924527be (DEFAULT_TABLE table=test-table [id=f65e33b84bfc49a0a5c7ae54f4c3ebbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:19.012188 3006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c91a2708344143888ad4fdb3924527be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:19.014338 3109 tablet_bootstrap.cc:492] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881: Bootstrap starting.
I20260807 22:38:19.014611 2859 tablet_service.cc:1467] Processing CreateTablet for tablet c91a2708344143888ad4fdb3924527be (DEFAULT_TABLE table=test-table [id=f65e33b84bfc49a0a5c7ae54f4c3ebbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:19.014897 2859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c91a2708344143888ad4fdb3924527be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:19.015293 3109 tablet_bootstrap.cc:654] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:19.016490 3109 tablet_bootstrap.cc:492] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881: No bootstrap required, opened a new log
I20260807 22:38:19.016601 3109 ts_tablet_manager.cc:1397] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 22:38:19.017060 3109 raft_consensus.cc:348] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.017202 3109 raft_consensus.cc:374] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:19.017246 3109 raft_consensus.cc:729] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c197b1f1f3b49a2ab25e11920a35881, State: Initialized, Role: FOLLOWER
I20260807 22:38:19.017374 3109 consensus_queue.cc:260] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.017525 3107 tablet_bootstrap.cc:492] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02: Bootstrap starting.
I20260807 22:38:19.017694 3109 ts_tablet_manager.cc:1428] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:19.018383 3107 tablet_bootstrap.cc:654] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:19.019625 3107 tablet_bootstrap.cc:492] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02: No bootstrap required, opened a new log
I20260807 22:38:19.019704 3107 ts_tablet_manager.cc:1397] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 22:38:19.020114 3107 raft_consensus.cc:348] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.020259 3107 raft_consensus.cc:374] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:19.020311 3107 raft_consensus.cc:729] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b97dedb59f45e3add7a4363e2b7f02, State: Initialized, Role: FOLLOWER
I20260807 22:38:19.020473 3107 consensus_queue.cc:260] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.020749 3107 ts_tablet_manager.cc:1428] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:19.021422 3108 tablet_bootstrap.cc:492] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4: Bootstrap starting.
I20260807 22:38:19.022305 3108 tablet_bootstrap.cc:654] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:19.023478 3108 tablet_bootstrap.cc:492] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4: No bootstrap required, opened a new log
I20260807 22:38:19.023574 3108 ts_tablet_manager.cc:1397] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260807 22:38:19.023944 3108 raft_consensus.cc:348] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.024052 3108 raft_consensus.cc:374] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:19.024081 3108 raft_consensus.cc:729] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457efe24ce774de3b43f4fb61319e4f4, State: Initialized, Role: FOLLOWER
I20260807 22:38:19.024215 3108 consensus_queue.cc:260] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.024448 3108 ts_tablet_manager.cc:1428] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:19.253253 3154 raft_consensus.cc:482] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:19.253425 3154 raft_consensus.cc:504] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.253980 3154 leader_election.cc:288] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881), 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105)
I20260807 22:38:19.254402 2879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c91a2708344143888ad4fdb3924527be" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" is_pre_election: true
I20260807 22:38:19.254460 3027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c91a2708344143888ad4fdb3924527be" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c197b1f1f3b49a2ab25e11920a35881" is_pre_election: true
I20260807 22:38:19.254590 2879 raft_consensus.cc:2454] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 0.
I20260807 22:38:19.254616 3027 raft_consensus.cc:2454] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 0.
I20260807 22:38:19.254957 2666 leader_election.cc:302] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c197b1f1f3b49a2ab25e11920a35881, 457efe24ce774de3b43f4fb61319e4f4; no voters:
I20260807 22:38:19.255189 3154 raft_consensus.cc:2781] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:38:19.255263 3154 raft_consensus.cc:482] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:19.255314 3154 raft_consensus.cc:3037] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:19.256532 3154 raft_consensus.cc:504] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.256861 3154 leader_election.cc:288] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 election: Requested vote from peers d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881), 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105)
I20260807 22:38:19.257233 3027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c91a2708344143888ad4fdb3924527be" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c197b1f1f3b49a2ab25e11920a35881"
I20260807 22:38:19.257223 2879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c91a2708344143888ad4fdb3924527be" candidate_uuid: "457efe24ce774de3b43f4fb61319e4f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b97dedb59f45e3add7a4363e2b7f02"
I20260807 22:38:19.257364 3027 raft_consensus.cc:3037] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:19.257364 2879 raft_consensus.cc:3037] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:19.258595 3027 raft_consensus.cc:2454] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 1.
I20260807 22:38:19.258595 2879 raft_consensus.cc:2454] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457efe24ce774de3b43f4fb61319e4f4 in term 1.
I20260807 22:38:19.258921 2666 leader_election.cc:302] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c197b1f1f3b49a2ab25e11920a35881, 457efe24ce774de3b43f4fb61319e4f4; no voters:
I20260807 22:38:19.259110 3154 raft_consensus.cc:2781] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:19.259238 3154 raft_consensus.cc:686] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 1 LEADER]: Becoming Leader. State: Replica: 457efe24ce774de3b43f4fb61319e4f4, State: Running, Role: LEADER
I20260807 22:38:19.259405 3154 consensus_queue.cc:237] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.261315 2568 catalog_manager.cc:5495] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65). New cstate: current_term: 1 leader_uuid: "457efe24ce774de3b43f4fb61319e4f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } health_report { overall_health: UNKNOWN } } }
I20260807 22:38:19.308669 3102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:19.305542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44182 (local address 127.26.52.65:40027)
0807 22:38:19.305683 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:19.305689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:19.305707 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:38:19.305762 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:19.305765 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:19.305816 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:19.305900 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:19.306162 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.306677 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.307548 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.307767 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.307874 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.308220 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:19.308290 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:19.308382 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:19.308476 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 22:38:19.308528 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:38:19.310549 3027 raft_consensus.cc:1261] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Refusing update from remote peer 457efe24ce774de3b43f4fb61319e4f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:19.310758 2879 raft_consensus.cc:1261] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Refusing update from remote peer 457efe24ce774de3b43f4fb61319e4f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:19.310935 3154 consensus_queue.cc:1035] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:19.311465 3154 consensus_queue.cc:1035] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:19.318221 2568 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:19.318342 2568 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:19.321626 2568 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b: Sending DeleteTablet for 3 replicas of tablet c91a2708344143888ad4fdb3924527be
I20260807 22:38:19.322199 2712 tablet_service.cc:1514] Processing DeleteTablet for tablet c91a2708344143888ad4fdb3924527be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:19 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:44168
I20260807 22:38:19.322371 3133 tablet_replica.cc:330] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4: stopping tablet replica
I20260807 22:38:19.322484 3133 raft_consensus.cc:2229] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:38:19.322450 2859 tablet_service.cc:1514] Processing DeleteTablet for tablet c91a2708344143888ad4fdb3924527be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:19 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:36438
I20260807 22:38:19.322650 3131 tablet_replica.cc:330] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02: stopping tablet replica
I20260807 22:38:19.322666 3133 raft_consensus.cc:2258] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:19.322779 3131 raft_consensus.cc:2229] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:19.322896 3131 raft_consensus.cc:2258] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:19.323112 3006 tablet_service.cc:1514] Processing DeleteTablet for tablet c91a2708344143888ad4fdb3924527be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:19 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:51142
I20260807 22:38:19.323285 3132 tablet_replica.cc:330] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881: stopping tablet replica
I20260807 22:38:19.323374 3133 ts_tablet_manager.cc:1905] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:19.323397 3132 raft_consensus.cc:2229] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:19.323511 3132 raft_consensus.cc:2258] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:19.323536 3131 ts_tablet_manager.cc:1905] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:19.323526 2569 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:38:19.323953 2569 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:38:19.324501 3132 ts_tablet_manager.cc:1905] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:19.325862 3133 ts_tablet_manager.cc:1918] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:19.325862 3131 ts_tablet_manager.cc:1918] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:19.325932 3131 log.cc:1196] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/c91a2708344143888ad4fdb3924527be
I20260807 22:38:19.325943 3133 log.cc:1196] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/c91a2708344143888ad4fdb3924527be
I20260807 22:38:19.326202 3133 ts_tablet_manager.cc:1939] T c91a2708344143888ad4fdb3924527be P 457efe24ce774de3b43f4fb61319e4f4: Deleting consensus metadata
I20260807 22:38:19.326202 3131 ts_tablet_manager.cc:1939] T c91a2708344143888ad4fdb3924527be P d7b97dedb59f45e3add7a4363e2b7f02: Deleting consensus metadata
I20260807 22:38:19.326994 3132 ts_tablet_manager.cc:1918] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:19.327075 3132 log.cc:1196] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/c91a2708344143888ad4fdb3924527be
I20260807 22:38:19.327150 2557 catalog_manager.cc:4841] TS 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65:40027): tablet c91a2708344143888ad4fdb3924527be (table test-table [id=f65e33b84bfc49a0a5c7ae54f4c3ebbc]) successfully deleted
I20260807 22:38:19.327334 3132 ts_tablet_manager.cc:1939] T c91a2708344143888ad4fdb3924527be P 1c197b1f1f3b49a2ab25e11920a35881: Deleting consensus metadata
I20260807 22:38:19.328008 2557 catalog_manager.cc:4841] TS 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105): tablet c91a2708344143888ad4fdb3924527be (table test-table [id=f65e33b84bfc49a0a5c7ae54f4c3ebbc]) successfully deleted
I20260807 22:38:19.328279 2556 catalog_manager.cc:4841] TS d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881): tablet c91a2708344143888ad4fdb3924527be (table test-table [id=f65e33b84bfc49a0a5c7ae54f4c3ebbc]) successfully deleted
I20260807 22:38:19.329114 2712 tablet_service.cc:1467] Processing CreateTablet for tablet bb08c727f203436482b05129921ec7b9 (DEFAULT_TABLE table=test-table [id=98cb5538432b44fc9ab6b7fb8b428184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:19.329258 2859 tablet_service.cc:1467] Processing CreateTablet for tablet bb08c727f203436482b05129921ec7b9 (DEFAULT_TABLE table=test-table [id=98cb5538432b44fc9ab6b7fb8b428184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:19.329391 2712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb08c727f203436482b05129921ec7b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:19.329460 3006 tablet_service.cc:1467] Processing CreateTablet for tablet bb08c727f203436482b05129921ec7b9 (DEFAULT_TABLE table=test-table [id=98cb5538432b44fc9ab6b7fb8b428184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:19.329579 2859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb08c727f203436482b05129921ec7b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:19.329718 3006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb08c727f203436482b05129921ec7b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:19.331465 3107 tablet_bootstrap.cc:492] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02: Bootstrap starting.
I20260807 22:38:19.331713 3108 tablet_bootstrap.cc:492] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4: Bootstrap starting.
I20260807 22:38:19.331758 3109 tablet_bootstrap.cc:492] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881: Bootstrap starting.
I20260807 22:38:19.332386 3107 tablet_bootstrap.cc:654] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:19.332502 3108 tablet_bootstrap.cc:654] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:19.332652 3109 tablet_bootstrap.cc:654] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:19.333568 3108 tablet_bootstrap.cc:492] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4: No bootstrap required, opened a new log
I20260807 22:38:19.333657 3108 ts_tablet_manager.cc:1397] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:38:19.333685 3107 tablet_bootstrap.cc:492] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02: No bootstrap required, opened a new log
I20260807 22:38:19.333760 3107 ts_tablet_manager.cc:1397] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:38:19.334064 3108 raft_consensus.cc:348] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.334131 3107 raft_consensus.cc:348] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.334187 3108 raft_consensus.cc:374] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:19.334219 3108 raft_consensus.cc:729] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457efe24ce774de3b43f4fb61319e4f4, State: Initialized, Role: FOLLOWER
I20260807 22:38:19.334224 3107 raft_consensus.cc:374] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:19.334263 3107 raft_consensus.cc:729] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b97dedb59f45e3add7a4363e2b7f02, State: Initialized, Role: FOLLOWER
I20260807 22:38:19.334367 3108 consensus_queue.cc:260] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.334405 3107 consensus_queue.cc:260] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.334653 3108 ts_tablet_manager.cc:1428] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:38:19.334676 3107 ts_tablet_manager.cc:1428] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:38:19.335574 3109 tablet_bootstrap.cc:492] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881: No bootstrap required, opened a new log
I20260807 22:38:19.335668 3109 ts_tablet_manager.cc:1397] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260807 22:38:19.336179 3109 raft_consensus.cc:348] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.336297 3109 raft_consensus.cc:374] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:19.336344 3109 raft_consensus.cc:729] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c197b1f1f3b49a2ab25e11920a35881, State: Initialized, Role: FOLLOWER
I20260807 22:38:19.336483 3109 consensus_queue.cc:260] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.336731 3109 ts_tablet_manager.cc:1428] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:38:19.431988 3113 raft_consensus.cc:482] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:19.432104 3113 raft_consensus.cc:504] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.433143 3113 leader_election.cc:288] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65:40027), d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881)
I20260807 22:38:19.437216 3184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:19.433411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40027 (local address 127.26.52.67:59601)
0807 22:38:19.433745 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:19.433759 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:19.433871 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:19.434139 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:19.434141 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:19.434159 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:19.434312 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:19.434320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.435111 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.435114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:19.436084 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:19.436093 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.436764 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.436768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:19.436863 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.436886 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:38:19.436977 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 22:38:19.437055 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":37,"thread_start_us":77,"threads_started":1}
I20260807 22:38:19.437216 3102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:19.433489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:59601 (local address 127.26.52.65:40027)
0807 22:38:19.433608 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:19.433613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:19.433848 (+ 235us) server_negotiation.cc:407] Connection header received
0807 22:38:19.433976 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:19.433982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:19.434040 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:19.434115 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:19.434437 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.434990 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.436235 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.436635 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.436727 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.436801 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:19.437011 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 22:38:19.437094 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:38:19.437264 3185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:19.433413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:44881 (local address 127.26.52.67:39051)
0807 22:38:19.433931 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:19.433946 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:19.434038 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:19.434315 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:19.434317 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:19.434331 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:19.434477 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:19.434484 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.435298 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.435301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:19.436100 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:19.436108 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.436809 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.436816 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:19.436934 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.436980 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 22:38:19.437058 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:38:19.437119 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":49,"thread_start_us":87,"threads_started":1}
I20260807 22:38:19.437538 3186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:19.433576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:39051 (local address 127.26.52.66:44881)
0807 22:38:19.433791 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:19.433797 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:19.434023 (+ 226us) server_negotiation.cc:407] Connection header received
0807 22:38:19.434145 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:19.434148 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:19.434198 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:19.434294 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:19.434592 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.435182 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.436243 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.436664 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.436827 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.436880 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:19.437090 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 22:38:19.437171 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":58,"threads_started":1}
I20260807 22:38:19.437898 2734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb08c727f203436482b05129921ec7b9" candidate_uuid: "1c197b1f1f3b49a2ab25e11920a35881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457efe24ce774de3b43f4fb61319e4f4" is_pre_election: true
I20260807 22:38:19.438072 2879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb08c727f203436482b05129921ec7b9" candidate_uuid: "1c197b1f1f3b49a2ab25e11920a35881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" is_pre_election: true
I20260807 22:38:19.438171 2734 raft_consensus.cc:2454] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c197b1f1f3b49a2ab25e11920a35881 in term 0.
I20260807 22:38:19.438234 2879 raft_consensus.cc:2454] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c197b1f1f3b49a2ab25e11920a35881 in term 0.
I20260807 22:38:19.438616 2957 leader_election.cc:302] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1c197b1f1f3b49a2ab25e11920a35881, 457efe24ce774de3b43f4fb61319e4f4, d7b97dedb59f45e3add7a4363e2b7f02; no voters:
I20260807 22:38:19.438855 3113 raft_consensus.cc:2781] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:38:19.438941 3113 raft_consensus.cc:482] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:19.438994 3113 raft_consensus.cc:3037] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:19.440310 3113 raft_consensus.cc:504] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.440590 3113 leader_election.cc:288] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [CANDIDATE]: Term 1 election: Requested vote from peers 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65:40027), d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881)
I20260807 22:38:19.441007 2734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb08c727f203436482b05129921ec7b9" candidate_uuid: "1c197b1f1f3b49a2ab25e11920a35881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457efe24ce774de3b43f4fb61319e4f4"
I20260807 22:38:19.441133 2734 raft_consensus.cc:3037] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:19.442260 2734 raft_consensus.cc:2454] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c197b1f1f3b49a2ab25e11920a35881 in term 1.
I20260807 22:38:19.442575 2879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb08c727f203436482b05129921ec7b9" candidate_uuid: "1c197b1f1f3b49a2ab25e11920a35881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b97dedb59f45e3add7a4363e2b7f02"
I20260807 22:38:19.442633 2958 leader_election.cc:302] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c197b1f1f3b49a2ab25e11920a35881, 457efe24ce774de3b43f4fb61319e4f4; no voters:
I20260807 22:38:19.442734 2879 raft_consensus.cc:3037] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:19.442862 3113 raft_consensus.cc:2781] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:19.443061 3113 raft_consensus.cc:686] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 LEADER]: Becoming Leader. State: Replica: 1c197b1f1f3b49a2ab25e11920a35881, State: Running, Role: LEADER
I20260807 22:38:19.443480 3113 consensus_queue.cc:237] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } }
I20260807 22:38:19.443941 2879 raft_consensus.cc:2454] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c197b1f1f3b49a2ab25e11920a35881 in term 1.
I20260807 22:38:19.445783 2568 catalog_manager.cc:5495] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67). New cstate: current_term: 1 leader_uuid: "1c197b1f1f3b49a2ab25e11920a35881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c197b1f1f3b49a2ab25e11920a35881" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 34105 } health_report { overall_health: HEALTHY } } }
I20260807 22:38:19.462929 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:19.458855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51154 (local address 127.26.52.67:34105)
0807 22:38:19.459117 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:19.459126 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:19.459138 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:38:19.459209 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:19.459211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:19.459256 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:19.459380 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:19.459614 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.460168 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.461027 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.461275 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.461382 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.461689 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:19.462268 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:19.462384 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:19.462695 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 22:38:19.462750 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":84,"threads_started":1}
I20260807 22:38:19.473449 3102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:19.469712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:36915 (local address 127.26.52.65:40027)
0807 22:38:19.469814 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:19.469818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:19.469969 (+ 151us) server_negotiation.cc:407] Connection header received
0807 22:38:19.470109 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:19.470112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:19.470158 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:19.470236 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:19.470974 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.471445 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.472341 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.472571 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.472681 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.472975 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:19.473097 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:19.473170 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:19.473260 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 22:38:19.473310 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 22:38:19.473466 3192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:19.469588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40027 (local address 127.26.52.67:36915)
0807 22:38:19.469850 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:19.469880 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:19.470014 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:19.470246 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:19.470249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:19.470255 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:38:19.470848 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:19.470858 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.471550 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.471556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:19.472220 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:19.472228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.472683 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.472686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:19.472781 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.472830 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:38:19.473185 (+ 355us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:38:19.473193 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:38:19.473251 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 22:38:19.473318 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":91,"threads_started":1}
I20260807 22:38:19.479226 2879 raft_consensus.cc:1261] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Refusing update from remote peer 1c197b1f1f3b49a2ab25e11920a35881: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:19.479405 2734 raft_consensus.cc:1261] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Refusing update from remote peer 1c197b1f1f3b49a2ab25e11920a35881: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:19.479743 3187 consensus_queue.cc:1035] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7b97dedb59f45e3add7a4363e2b7f02" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:19.480288 3187 consensus_queue.cc:1035] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457efe24ce774de3b43f4fb61319e4f4" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:19.497287 3197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:19.493818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:34105 (local address 127.26.52.65:36861)
0807 22:38:19.494301 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:19.494318 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:19.494446 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:19.494717 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:19.494719 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:19.494725 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:38:19.494803 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:19.494808 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.495415 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.495417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:19.496052 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:19.496062 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.496589 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.496593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:19.496686 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.496712 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:38:19.497008 (+ 296us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:38:19.497018 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 22:38:19.497087 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 22:38:19.497166 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":94,"threads_started":1}
I20260807 22:38:19.497282 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:19.493890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:36861 (local address 127.26.52.67:34105)
0807 22:38:19.494013 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:19.494016 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:19.494384 (+ 368us) server_negotiation.cc:407] Connection header received
0807 22:38:19.494604 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:19.494607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:19.494648 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:19.494710 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:19.494866 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.495333 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.496194 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:19.496493 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:19.496587 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:19.496830 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:19.496906 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:19.497000 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:19.497102 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 22:38:19.497155 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:38:19.519572 2569 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:19.519742 2569 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:19.521812 2569 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ad89665f69640bcbbde6cfeb2de162b: Sending DeleteTablet for 3 replicas of tablet bb08c727f203436482b05129921ec7b9
I20260807 22:38:19.522383 2859 tablet_service.cc:1514] Processing DeleteTablet for tablet bb08c727f203436482b05129921ec7b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:19 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:36438
I20260807 22:38:19.522485 2712 tablet_service.cc:1514] Processing DeleteTablet for tablet bb08c727f203436482b05129921ec7b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:19 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:44168
I20260807 22:38:19.522512 3006 tablet_service.cc:1514] Processing DeleteTablet for tablet bb08c727f203436482b05129921ec7b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:19 UTC) from {username='oryx', principal='oryx/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:51142
I20260807 22:38:19.522586 3131 tablet_replica.cc:330] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02: stopping tablet replica
I20260807 22:38:19.522634 3133 tablet_replica.cc:330] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4: stopping tablet replica
I20260807 22:38:19.522701 3132 tablet_replica.cc:330] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881: stopping tablet replica
I20260807 22:38:19.522699 3131 raft_consensus.cc:2229] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:19.522723 3133 raft_consensus.cc:2229] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:19.522799 3132 raft_consensus.cc:2229] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:38:19.522814 3133 raft_consensus.cc:2258] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:19.522814 3131 raft_consensus.cc:2258] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:19.523061 3132 raft_consensus.cc:2258] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:19.523510 3131 ts_tablet_manager.cc:1905] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:19.523510 3133 ts_tablet_manager.cc:1905] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:19.523964 3132 ts_tablet_manager.cc:1905] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:19.526016 3131 ts_tablet_manager.cc:1918] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:38:19.526016 3133 ts_tablet_manager.cc:1918] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:38:19.526086 3131 log.cc:1196] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/bb08c727f203436482b05129921ec7b9
I20260807 22:38:19.526086 3133 log.cc:1196] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/bb08c727f203436482b05129921ec7b9
I20260807 22:38:19.526352 3133 ts_tablet_manager.cc:1939] T bb08c727f203436482b05129921ec7b9 P 457efe24ce774de3b43f4fb61319e4f4: Deleting consensus metadata
I20260807 22:38:19.526367 3131 ts_tablet_manager.cc:1939] T bb08c727f203436482b05129921ec7b9 P d7b97dedb59f45e3add7a4363e2b7f02: Deleting consensus metadata
I20260807 22:38:19.526461 3132 ts_tablet_manager.cc:1918] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:38:19.526535 3132 log.cc:1196] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/bb08c727f203436482b05129921ec7b9
I20260807 22:38:19.526784 3132 ts_tablet_manager.cc:1939] T bb08c727f203436482b05129921ec7b9 P 1c197b1f1f3b49a2ab25e11920a35881: Deleting consensus metadata
I20260807 22:38:19.527175 2556 catalog_manager.cc:4841] TS d7b97dedb59f45e3add7a4363e2b7f02 (127.26.52.66:44881): tablet bb08c727f203436482b05129921ec7b9 (table test-table [id=98cb5538432b44fc9ab6b7fb8b428184]) successfully deleted
I20260807 22:38:19.527175 2557 catalog_manager.cc:4841] TS 457efe24ce774de3b43f4fb61319e4f4 (127.26.52.65:40027): tablet bb08c727f203436482b05129921ec7b9 (table test-table [id=98cb5538432b44fc9ab6b7fb8b428184]) successfully deleted
I20260807 22:38:19.527751 2557 catalog_manager.cc:4841] TS 1c197b1f1f3b49a2ab25e11920a35881 (127.26.52.67:34105): tablet bb08c727f203436482b05129921ec7b9 (table test-table [id=98cb5538432b44fc9ab6b7fb8b428184]) successfully deleted
I20260807 22:38:19.528028 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 2645
I20260807 22:38:19.541002 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 2791
I20260807 22:38:19.550495 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 2939
I20260807 22:38:19.557767 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 2538
2026-08-07T22:38:19Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3399 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:38:19 dist-test-slave-8w9v krb5kdc[3202](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:38:19 dist-test-slave-8w9v krb5kdc[3202](info): set up 2 sockets
Aug 07 22:38:19 dist-test-slave-8w9v krb5kdc[3202](info): commencing operation
krb5kdc: starting...
W20260807 22:38:20.632413 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:38:20 dist-test-slave-8w9v krb5kdc[3202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:38:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:38:20.752418 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:36759
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:37751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:36759
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:20.867292 3217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:20.867533 3217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:20.867605 3217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:20.871600 3217 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:20.871655 3217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:20.871675 3217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:20.871732 3217 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:20.871762 3217 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:20.877070 3217 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:37751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:36759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:36759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:20.878118 3217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:20.879142 3217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:20.888015 3222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:20.888019 3225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:20.888089 3223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:20.888258 3217 server_base.cc:1034] running on GCE node
I20260807 22:38:20.888888 3217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:20.889983 3217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:20.891168 3217 hybrid_clock.cc:648] HybridClock initialized: now 1786142300891157 us; error 27 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T22:38:20Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1339 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:38:20 dist-test-slave-8w9v krb5kdc[3231](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:38:20 dist-test-slave-8w9v krb5kdc[3231](info): set up 2 sockets
Aug 07 22:38:20 dist-test-slave-8w9v krb5kdc[3231](info): commencing operation
krb5kdc: starting...
W20260807 22:38:21.966594 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:38:22 dist-test-slave-8w9v krb5kdc[3231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:38:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:38:22.092993 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40813
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:40813
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:22.201517 3244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:22.201774 3244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:22.201875 3244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:22.205893 3244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:22.205971 3244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:22.206010 3244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:22.206063 3244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:22.206099 3244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:22.211269 3244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:40813
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:22.212306 3244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:22.213245 3244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:22.221545 3250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:22.221612 3252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:22.221539 3249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:22.221603 3244 server_base.cc:1034] running on GCE node
I20260807 22:38:22.222306 3244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:22.223410 3244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:22.224575 3244 hybrid_clock.cc:648] HybridClock initialized: now 1786142302224556 us; error 30 us; skew 500 ppm
Aug 07 22:38:22 dist-test-slave-8w9v krb5kdc[3231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142302, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:22.227185 3244 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:38:22.228037 3244 webserver.cc:460] Webserver started at http://127.26.52.126:35595/ using document root <none> and password file <none>
I20260807 22:38:22.228616 3244 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:22.228708 3244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:22.228937 3244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:22.230891 3244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "9c0b4a66a3ccac92da09e92eab88ea77"
server_key_iv: "03a8fd5a1ab3550018a9fcb139fe19f6"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.231470 3244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "9c0b4a66a3ccac92da09e92eab88ea77"
server_key_iv: "03a8fd5a1ab3550018a9fcb139fe19f6"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.235129 3244 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:38:22.237510 3259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:22.238734 3244 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:38:22.238873 3244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "9c0b4a66a3ccac92da09e92eab88ea77"
server_key_iv: "03a8fd5a1ab3550018a9fcb139fe19f6"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.238983 3244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:22.252892 3244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:22.255523 3244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:22.255721 3244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:22.262826 3244 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:40813
I20260807 22:38:22.262859 3313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:40813 every 8 connection(s)
I20260807 22:38:22.263827 3244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:22.266711 3314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:22.268507 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 3244
I20260807 22:38:22.268653 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:22.268945 26833 external_mini_cluster.cc:1428] Setting key b621604c89e686b8f023c30481a2c05d
I20260807 22:38:22.273674 3314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c: Bootstrap starting.
I20260807 22:38:22.276383 3314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:22.277277 3314 log.cc:824] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:38:22 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:22.279386 3314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c: No bootstrap required, opened a new log
I20260807 22:38:22.282943 3314 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } }
I20260807 22:38:22.283181 3314 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:22.283259 3314 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3b1cb0a52d4f3e8e33c4b32437806c, State: Initialized, Role: FOLLOWER
I20260807 22:38:22.283679 3318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:22.270373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58626 (local address 127.26.52.126:40813)
0807 22:38:22.270806 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:22.270825 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:22.270866 (+ 41us) server_negotiation.cc:407] Connection header received
0807 22:38:22.271756 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:22.271780 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:22.272219 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:22.272588 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:22.273255 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:22.274738 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:22.275583 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:22.276309 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:22.276478 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:22.278996 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:22.279002 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:22.279017 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:22.279048 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:22.280834 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:22.281285 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:22.281290 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:22.281295 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:22.281398 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:22.281691 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:22.281695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:22.281697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:22.282070 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:22.282290 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:22.282576 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 22:38:22.282838 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":114,"threads_started":1}
I20260807 22:38:22.283685 3314 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } }
I20260807 22:38:22.283936 3314 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:22.284014 3314 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:22.284111 3314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:22.285156 3314 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } }
I20260807 22:38:22.285488 3314 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3b1cb0a52d4f3e8e33c4b32437806c; no voters:
I20260807 22:38:22.285820 3314 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:22.285917 3320 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:22.286173 3320 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 1 LEADER]: Becoming Leader. State: Replica: 1e3b1cb0a52d4f3e8e33c4b32437806c, State: Running, Role: LEADER
I20260807 22:38:22.286506 3320 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } }
I20260807 22:38:22.287073 3314 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:22.288192 3321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } } }
I20260807 22:38:22.288321 3321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:22.288681 3322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3b1cb0a52d4f3e8e33c4b32437806c. Latest consensus state: current_term: 1 leader_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } } }
I20260807 22:38:22.288755 3329 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:22.288858 3322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:22.291595 3329 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:22.296726 3329 catalog_manager.cc:1347] Generated new cluster ID: 9abdee92509b40778afa6cdb6742df45
I20260807 22:38:22.296787 3329 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:22.305848 3329 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:22.307011 3329 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:22.312840 3329 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c: Generated new TSK 0
I20260807 22:38:22.313591 3329 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:38:22.345058 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40813
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:22.457430 3342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:22.457712 3342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:22.457803 3342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:22.461776 3342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:22.461853 3342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:22.461937 3342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:22.467003 3342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:22.468015 3342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:22.469120 3342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:22.478825 3351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:22.479027 3342 server_base.cc:1034] running on GCE node
W20260807 22:38:22.479219 3349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:22.478858 3348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:22.480473 3342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:22.481264 3342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:22.482458 3342 hybrid_clock.cc:648] HybridClock initialized: now 1786142302482386 us; error 90 us; skew 500 ppm
Aug 07 22:38:22 dist-test-slave-8w9v krb5kdc[3231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142302, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:22.485251 3342 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:38:22.486066 3342 webserver.cc:460] Webserver started at http://127.26.52.65:43939/ using document root <none> and password file <none>
I20260807 22:38:22.486560 3342 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:22.486615 3342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:22.486769 3342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:22.488930 3342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "90d72cd8ea8d43039af6d7ec997c2b11"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "07c0206a88510526ddb26c0d552b8564"
server_key_iv: "4d252c76a318ad61cdb96507919deedd"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.489518 3342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "90d72cd8ea8d43039af6d7ec997c2b11"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "07c0206a88510526ddb26c0d552b8564"
server_key_iv: "4d252c76a318ad61cdb96507919deedd"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.493110 3342 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:38:22.495455 3358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:22.496657 3342 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:22.496784 3342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "90d72cd8ea8d43039af6d7ec997c2b11"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "07c0206a88510526ddb26c0d552b8564"
server_key_iv: "4d252c76a318ad61cdb96507919deedd"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.496888 3342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:22.512171 3342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:22.515219 3342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:22.515404 3342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:22.515974 3342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:22.516824 3342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:22.516897 3342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:22.516963 3342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:22.517007 3342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:22.525913 3342 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:34335
I20260807 22:38:22.525940 3479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:34335 every 8 connection(s)
I20260807 22:38:22.526753 3342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:22.531635 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 3342
I20260807 22:38:22.531793 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:38:22.532115 26833 external_mini_cluster.cc:1428] Setting key 2dea0a40a27b2f0cf79846277f01af4e
Aug 07 22:38:22 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142302, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:22.541322 3318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:22.528534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:34871 (local address 127.26.52.126:40813)
0807 22:38:22.528673 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:22.528677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:22.529451 (+ 774us) server_negotiation.cc:407] Connection header received
0807 22:38:22.530787 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:22.530790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:22.530848 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:22.530958 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:22.532185 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:22.532910 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:22.534400 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:22.534732 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:22.534815 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:22.537616 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:22.537619 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:22.537622 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:22.537644 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:22.539083 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:22.539696 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:22.539699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:22.539700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:22.539790 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:22.540250 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:22.540252 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:22.540253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:22.540415 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:22.540493 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:22.541114 (+ 621us) server_negotiation.cc:299] Negotiation successful
0807 22:38:22.541210 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:38:22.542455 3482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:22.528877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:34871)
0807 22:38:22.529296 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:22.529347 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:22.530584 (+ 1237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:22.531126 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:22.531132 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:22.531474 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:22.532012 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:22.532028 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:22.533035 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:22.533038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:22.534267 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:22.534281 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:22.534886 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:22.534892 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:22.535130 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:22.535758 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:22.535773 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:22.537458 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:22.539199 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:22.539208 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:22.539223 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:22.539597 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:22.539899 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:22.539905 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:22.539909 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:22.540109 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:22.540530 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:22.540539 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:22.540837 (+ 298us) client_negotiation.cc:769] Sending connection context
0807 22:38:22.541066 (+ 229us) client_negotiation.cc:240] Negotiation successful
0807 22:38:22.541386 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":112,"threads_started":1}
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:38:22.543635 3480 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40813
I20260807 22:38:22.543821 3480 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:22.544315 3480 heartbeater.cc:511] Master 127.26.52.126:40813 requested a full tablet report, sending...
I20260807 22:38:22.545768 3277 ts_manager.cc:194] Registered new tserver with Master: 90d72cd8ea8d43039af6d7ec997c2b11 (127.26.52.65:34335)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:38:22.546955 3277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:34871
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:38:22.560472 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40813
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:22.669729 3485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:22.669955 3485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:22.670025 3485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:22.674415 3485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:22.674474 3485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:22.674528 3485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:22.679800 3485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:22.680761 3485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:22.681659 3485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:22.691236 3491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:22.691247 3490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:22.691314 3485 server_base.cc:1034] running on GCE node
W20260807 22:38:22.691267 3494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:22.691936 3485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:22.692600 3485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:22.693779 3485 hybrid_clock.cc:648] HybridClock initialized: now 1786142302693751 us; error 40 us; skew 500 ppm
Aug 07 22:38:22 dist-test-slave-8w9v krb5kdc[3231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142302, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:22.696547 3485 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:38:22.697320 3485 webserver.cc:460] Webserver started at http://127.26.52.66:32907/ using document root <none> and password file <none>
I20260807 22:38:22.697860 3485 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:22.697954 3485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:22.698182 3485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:22.700197 3485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "89870d4e91c14ce296e54e21384f194e"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "12755759a8a512e2ba5ccc1acabf4c8d"
server_key_iv: "2a2aed5941474f22c0496710a026cf04"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.700767 3485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "89870d4e91c14ce296e54e21384f194e"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "12755759a8a512e2ba5ccc1acabf4c8d"
server_key_iv: "2a2aed5941474f22c0496710a026cf04"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.704216 3485 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:38:22.706498 3501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:22.707638 3485 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:22.707754 3485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "89870d4e91c14ce296e54e21384f194e"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "12755759a8a512e2ba5ccc1acabf4c8d"
server_key_iv: "2a2aed5941474f22c0496710a026cf04"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.707849 3485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:22.763756 3485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:22.767819 3485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:22.768074 3485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:22.768848 3485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:22.769867 3485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:22.769928 3485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:22.770012 3485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:22.770072 3485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:22.780623 3485 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:41007
I20260807 22:38:22.780649 3619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:41007 every 8 connection(s)
I20260807 22:38:22.781661 3485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:22.786806 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 3485
I20260807 22:38:22.786954 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:38:22.787321 26833 external_mini_cluster.cc:1428] Setting key 385f7d73828f38c89076e630e09566a7
Aug 07 22:38:22 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142302, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:22.797464 3318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:22.783772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:56139 (local address 127.26.52.126:40813)
0807 22:38:22.783918 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:22.783923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:22.784889 (+ 966us) server_negotiation.cc:407] Connection header received
0807 22:38:22.786106 (+ 1217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:22.786109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:22.786162 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:22.786259 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:22.787719 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:22.788609 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:22.790320 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:22.790562 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:22.790663 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:22.793704 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:22.793707 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:22.793709 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:22.793733 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:22.795176 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:22.795830 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:22.795833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:22.795834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:22.795904 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:22.796342 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:22.796344 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:22.796345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:22.796516 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:22.796611 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:22.797237 (+ 626us) server_negotiation.cc:299] Negotiation successful
0807 22:38:22.797332 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:38:22.798629 3622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:22.784237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:56139)
0807 22:38:22.784735 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:22.784775 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:22.785910 (+ 1135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:22.786394 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:22.786399 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:22.786889 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:22.787565 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:22.787585 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:22.788792 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:22.788795 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:22.790170 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:22.790184 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:22.790724 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:22.790730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:22.790955 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:22.791649 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:22.791664 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:22.793537 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:22.795301 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:22.795310 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:22.795330 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:22.795719 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:22.796013 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:22.796017 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:22.796020 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:22.796250 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:22.796644 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:22.796651 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:22.796973 (+ 322us) client_negotiation.cc:769] Sending connection context
0807 22:38:22.797188 (+ 215us) client_negotiation.cc:240] Negotiation successful
0807 22:38:22.797532 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":156,"threads_started":1}
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:38:22.799774 3620 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40813
I20260807 22:38:22.800074 3620 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:22.800673 3620 heartbeater.cc:511] Master 127.26.52.126:40813 requested a full tablet report, sending...
I20260807 22:38:22.801873 3277 ts_manager.cc:194] Registered new tserver with Master: 89870d4e91c14ce296e54e21384f194e (127.26.52.66:41007)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
I20260807 22:38:22.802546 3277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:56139
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:38:22.816112 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40813
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:22.925020 3625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:22.925266 3625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:22.925338 3625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:22.929396 3625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:22.929467 3625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:22.929563 3625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:22.934980 3625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:22.936071 3625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:22.937140 3625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:22.947048 3631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:22.947289 3625 server_base.cc:1034] running on GCE node
W20260807 22:38:22.947043 3633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:22.947043 3630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:22.947834 3625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:22.948550 3625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:22.949743 3625 hybrid_clock.cc:648] HybridClock initialized: now 1786142302949726 us; error 31 us; skew 500 ppm
Aug 07 22:38:22 dist-test-slave-8w9v krb5kdc[3231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142302, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:22.952678 3625 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:38:22.953606 3625 webserver.cc:460] Webserver started at http://127.26.52.67:41231/ using document root <none> and password file <none>
I20260807 22:38:22.954202 3625 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:22.954298 3625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:22.954538 3625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:22.956714 3625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "bf8dd70accd8468aa8dfa0c73616e53e"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "e4a288b40969006dceb4532a9efe4ebd"
server_key_iv: "46845a8838a0de77db14c9c22cc294dd"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.957283 3625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "bf8dd70accd8468aa8dfa0c73616e53e"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "e4a288b40969006dceb4532a9efe4ebd"
server_key_iv: "46845a8838a0de77db14c9c22cc294dd"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.961021 3625 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:38:22.963395 3640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:22.964655 3625 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:38:22.964799 3625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "bf8dd70accd8468aa8dfa0c73616e53e"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "e4a288b40969006dceb4532a9efe4ebd"
server_key_iv: "46845a8838a0de77db14c9c22cc294dd"
server_key_version: "encryptionkey@0"
I20260807 22:38:22.964907 3625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:22.985004 3625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:22.988068 3625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:22.988348 3625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:22.988992 3625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:22.989892 3625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:22.989971 3625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:22.990038 3625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:22.990089 3625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:22.999073 3625 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:37755
I20260807 22:38:22.999135 3758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:37755 every 8 connection(s)
I20260807 22:38:23.000041 3625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:38:23.001998 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 3625
I20260807 22:38:23.002158 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:38:23.002503 26833 external_mini_cluster.cc:1428] Setting key ce88a29e23432a47e49e7900b4d46497
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142302, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:23.014267 3318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.002159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:47029 (local address 127.26.52.126:40813)
0807 22:38:23.002320 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.002326 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.003235 (+ 909us) server_negotiation.cc:407] Connection header received
0807 22:38:23.004890 (+ 1655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.004893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.004951 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.005028 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.006181 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.006728 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.007877 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.008173 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.008274 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.010856 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:23.010859 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:23.010861 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:23.010885 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:23.012445 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:23.012962 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:23.012965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:23.012966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:23.013037 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:23.013327 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:23.013329 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:23.013330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:23.013506 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:23.013580 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:23.014046 (+ 466us) server_negotiation.cc:299] Negotiation successful
0807 22:38:23.014143 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:38:23.015211 3762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.002584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:47029)
0807 22:38:23.003081 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:23.003134 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:23.004659 (+ 1525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:23.005198 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:23.005205 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:23.005555 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:23.006036 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.006051 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.006857 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.006861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.007746 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.007756 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.008333 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.008337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.008498 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.009159 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:23.009177 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:23.010701 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:23.012569 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:23.012581 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:23.012607 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:23.012869 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:23.013116 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:23.013118 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:23.013119 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:23.013249 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:23.013592 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:23.013596 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:23.013826 (+ 230us) client_negotiation.cc:769] Sending connection context
0807 22:38:23.013998 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 22:38:23.014250 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":127,"threads_started":1}
I20260807 22:38:23.016373 3759 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40813
I20260807 22:38:23.016641 3759 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:23.017158 3759 heartbeater.cc:511] Master 127.26.52.126:40813 requested a full tablet report, sending...
I20260807 22:38:23.018183 3277 ts_manager.cc:194] Registered new tserver with Master: bf8dd70accd8468aa8dfa0c73616e53e (127.26.52.67:37755)
I20260807 22:38:23.018711 3277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:47029
I20260807 22:38:23.028851 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab.
Entry for principal oryx/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab.
WARNING: no policy specified for oryx/127.26.52.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab.
Entry for principal oryx/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab.
WARNING: no policy specified for oryx/127.26.52.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab.
Entry for principal oryx/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab.
I20260807 22:38:23.102177 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 3342
I20260807 22:38:23.109839 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 3485
I20260807 22:38:23.116935 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 3625
I20260807 22:38:23.124861 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 3244
I20260807 22:38:23.134135 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40813
--webserver_interface=127.26.52.126
--webserver_port=35595
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:40813
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:23.253113 3769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:23.253454 3769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:23.253544 3769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:23.257599 3769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:23.257707 3769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:23.257754 3769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:23.257817 3769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:23.257862 3769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:23.263353 3769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:40813
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=35595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:23.264626 3769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:23.265771 3769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:23.274629 3775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:23.274633 3774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:23.274629 3777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:23.274767 3769 server_base.cc:1034] running on GCE node
I20260807 22:38:23.275573 3769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:23.276857 3769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:23.278064 3769 hybrid_clock.cc:648] HybridClock initialized: now 1786142303278033 us; error 41 us; skew 500 ppm
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142303, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:23.280884 3769 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:38:23.281804 3769 webserver.cc:460] Webserver started at http://127.26.52.126:35595/ using document root <none> and password file <none>
I20260807 22:38:23.282380 3769 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:23.282518 3769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:23.286263 3769 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260807 22:38:23.288340 3785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:23.289546 3769 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:38:23.289686 3769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "9c0b4a66a3ccac92da09e92eab88ea77"
server_key_iv: "03a8fd5a1ab3550018a9fcb139fe19f6"
server_key_version: "encryptionkey@0"
I20260807 22:38:23.290210 3769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:23.314256 3769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:23.317679 3769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:23.317894 3769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:23.325443 3769 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:40813
I20260807 22:38:23.325462 3841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:40813 every 8 connection(s)
I20260807 22:38:23.326532 3769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:23.330947 3842 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:38:23.330994 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 3769
I20260807 22:38:23.331493 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:34335
--local_ip_for_outbound_sockets=127.26.52.65
--tserver_master_addrs=127.26.52.126:40813
--webserver_port=43939
--webserver_interface=127.26.52.65
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.52.65
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:38:23.333390 3842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c: Bootstrap starting.
I20260807 22:38:23.350806 3842 log.cc:824] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:23.357512 3842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:38:23.357909 3842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c: Bootstrap complete.
I20260807 22:38:23.362159 3842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } }
I20260807 22:38:23.362569 3842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3b1cb0a52d4f3e8e33c4b32437806c, State: Initialized, Role: FOLLOWER
I20260807 22:38:23.363118 3842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } }
I20260807 22:38:23.363269 3842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:23.363358 3842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:23.363469 3842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:38:23.365458 3842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } }
I20260807 22:38:23.365784 3842 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3b1cb0a52d4f3e8e33c4b32437806c; no voters:
I20260807 22:38:23.366094 3842 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:38:23.366252 3846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:38:23.366489 3846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [term 2 LEADER]: Becoming Leader. State: Replica: 1e3b1cb0a52d4f3e8e33c4b32437806c, State: Running, Role: LEADER
I20260807 22:38:23.366851 3846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } }
I20260807 22:38:23.367509 3842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:23.368291 3847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3b1cb0a52d4f3e8e33c4b32437806c. Latest consensus state: current_term: 2 leader_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } } }
I20260807 22:38:23.368412 3847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:23.368770 3849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3b1cb0a52d4f3e8e33c4b32437806c" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40813 } } }
I20260807 22:38:23.368906 3849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:23.369215 3854 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:23.372480 3854 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:23.373162 3854 catalog_manager.cc:1259] Loaded cluster ID: 9abdee92509b40778afa6cdb6742df45
I20260807 22:38:23.373221 3854 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:23.375470 3854 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:23.376158 3854 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1e3b1cb0a52d4f3e8e33c4b32437806c: Loaded TSK: 0
I20260807 22:38:23.377470 3854 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:38:23.446807 3844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:23.447060 3844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:23.447103 3844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:23.451267 3844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:23.451318 3844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:23.451395 3844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:23.456636 3844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.65.keytab
--principal=oryx/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:34335
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=43939
--tserver_master_addrs=127.26.52.126:40813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:23.457638 3844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:23.458624 3844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:23.469403 3873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:23.469419 3872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:23.469419 3875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:23.469935 3844 server_base.cc:1034] running on GCE node
I20260807 22:38:23.470386 3844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:23.471175 3844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:23.472386 3844 hybrid_clock.cc:648] HybridClock initialized: now 1786142303472353 us; error 39 us; skew 500 ppm
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142303, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:23.475766 3844 init.cc:377] Logged in from keytab as oryx/127.26.52.65@KRBTEST.COM (short username oryx)
I20260807 22:38:23.476917 3844 webserver.cc:460] Webserver started at http://127.26.52.65:43939/ using document root <none> and password file <none>
I20260807 22:38:23.477682 3844 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:23.477828 3844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:23.483147 3844 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:38:23.485857 3883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:23.487380 3844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:38:23.487520 3844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "90d72cd8ea8d43039af6d7ec997c2b11"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "07c0206a88510526ddb26c0d552b8564"
server_key_iv: "4d252c76a318ad61cdb96507919deedd"
server_key_version: "encryptionkey@0"
I20260807 22:38:23.488246 3844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:23.503085 3844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:23.506629 3844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:23.506824 3844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:23.507468 3844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:23.508561 3844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:23.508627 3844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:23.508679 3844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:23.508710 3844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:23.519445 3844 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:34335
I20260807 22:38:23.519536 4003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:34335 every 8 connection(s)
I20260807 22:38:23.520610 3844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:23.528741 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 3844
I20260807 22:38:23.529232 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:41007
--local_ip_for_outbound_sockets=127.26.52.66
--tserver_master_addrs=127.26.52.126:40813
--webserver_port=32907
--webserver_interface=127.26.52.66
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.52.66
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:23.534194 4007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.523021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:34219)
0807 22:38:23.523487 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:23.523527 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:23.524896 (+ 1369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:23.525951 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:23.525959 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:23.526377 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:23.526809 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.526822 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.528080 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.528083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.529080 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.529090 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.529912 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.529916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.530102 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.530717 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:23.530743 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:23.533377 (+ 2634us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":128,"threads_started":1}
W20260807 22:38:23.534588 4006 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:23.522816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:34219 (local address 127.26.52.126:40813)
0807 22:38:23.523236 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.523274 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.523641 (+ 367us) server_negotiation.cc:407] Connection header received
0807 22:38:23.525294 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.525304 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.525571 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.525878 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.526999 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.527941 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.529215 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.529738 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.529910 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.533679 (+ 3769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:34219: BlockingRecv error: recv got EOF from 127.26.52.65:34219 (error 108)
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":119,"threads_started":1}
W20260807 22:38:23.534842 4004 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:40813 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.52.126:40813: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:23.540706 4007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.535301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:35749)
0807 22:38:23.535479 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:23.535490 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:23.535549 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:23.535792 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:23.535794 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:23.535920 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:23.536023 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.536027 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.537129 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.537131 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.537688 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.537696 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.538347 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.538349 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.538417 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.538954 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:23.538965 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:23.540620 (+ 1655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110}
W20260807 22:38:23.540932 4006 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:23.535392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:35749 (local address 127.26.52.126:40813)
0807 22:38:23.535528 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.535534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.535551 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:38:23.535618 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.535622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.535677 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.535772 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.536160 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.537021 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.537808 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.538220 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.538347 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.540793 (+ 2446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:35749: BlockingRecv error: recv got EOF from 127.26.52.65:35749 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:23.546486 4007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.541194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:42835)
0807 22:38:23.541468 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:23.541481 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:23.541549 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:23.541777 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:23.541779 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:23.541893 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:23.541957 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.541961 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.542934 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.542936 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.543424 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.543432 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.543955 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.543957 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.544014 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.544462 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:23.544492 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:23.546403 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171}
W20260807 22:38:23.546648 4006 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:23.541310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:42835 (local address 127.26.52.126:40813)
0807 22:38:23.541465 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.541469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.541518 (+ 49us) server_negotiation.cc:407] Connection header received
0807 22:38:23.541652 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.541654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.541697 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.541766 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.542047 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.542818 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.543527 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.543859 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.543954 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.546553 (+ 2599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:42835: BlockingRecv error: recv got EOF from 127.26.52.65:42835 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 22:38:23.546687 4004 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:38:23.642922 4008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:23.643162 4008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:23.643203 4008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:23.647186 4008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:23.647244 4008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:23.647300 4008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:23.652724 4008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.66.keytab
--principal=oryx/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:41007
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=32907
--tserver_master_addrs=127.26.52.126:40813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:23.653644 4008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:23.654582 4008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:23.663936 4014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:23.663942 4016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:23.663972 4013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:23.664192 4008 server_base.cc:1034] running on GCE node
I20260807 22:38:23.665042 4008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:23.665730 4008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:23.666931 4008 hybrid_clock.cc:648] HybridClock initialized: now 1786142303666904 us; error 50 us; skew 500 ppm
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142303, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:23.669831 4008 init.cc:377] Logged in from keytab as oryx/127.26.52.66@KRBTEST.COM (short username oryx)
I20260807 22:38:23.670658 4008 webserver.cc:460] Webserver started at http://127.26.52.66:32907/ using document root <none> and password file <none>
I20260807 22:38:23.671214 4008 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:23.671335 4008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:23.675004 4008 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:23.677024 4023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:23.678184 4008 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:23.678326 4008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "89870d4e91c14ce296e54e21384f194e"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "12755759a8a512e2ba5ccc1acabf4c8d"
server_key_iv: "2a2aed5941474f22c0496710a026cf04"
server_key_version: "encryptionkey@0"
I20260807 22:38:23.678843 4008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:23.707508 4008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:23.710397 4008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:23.710614 4008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:23.711242 4008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:23.712107 4008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:23.712200 4008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:23.712275 4008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:23.712327 4008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:23.721163 4008 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:41007
I20260807 22:38:23.721201 4143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:41007 every 8 connection(s)
I20260807 22:38:23.722153 4008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:23.726537 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 4008
I20260807 22:38:23.727087 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:37755
--local_ip_for_outbound_sockets=127.26.52.67
--tserver_master_addrs=127.26.52.126:40813
--webserver_port=41231
--webserver_interface=127.26.52.67
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.52.67
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:38:23.733975 4006 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:23.723933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:54587 (local address 127.26.52.126:40813)
0807 22:38:23.724071 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.724075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.724957 (+ 882us) server_negotiation.cc:407] Connection header received
0807 22:38:23.726414 (+ 1457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.726417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.726468 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.726548 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.728208 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.728809 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.729935 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.730170 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.730257 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.733868 (+ 3611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:54587: BlockingRecv error: recv got EOF from 127.26.52.66:54587 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:38:23.734845 4146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.724380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:54587)
0807 22:38:23.724808 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:23.724851 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:23.726107 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:23.726778 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:23.726788 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:23.727320 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:23.728014 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.728036 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.728953 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.728956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.729801 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.729810 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.730307 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.730310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.730451 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.731036 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:23.731053 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:23.733758 (+ 2705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":105,"threads_started":1}
W20260807 22:38:23.735306 4144 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:40813 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.52.126:40813: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:23.741194 4146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.735733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:42279)
0807 22:38:23.735843 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:23.735860 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:23.735945 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:23.736369 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:23.736371 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:23.736500 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:23.736587 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.736592 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.737649 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.737651 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.738164 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.738171 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.738818 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.738820 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.738885 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.739364 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:23.739376 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:23.741075 (+ 1699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 22:38:23.741315 4006 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:23.735929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:42279 (local address 127.26.52.126:40813)
0807 22:38:23.736087 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.736093 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.736111 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:38:23.736194 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.736199 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.736255 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.736356 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.736700 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.737538 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.738277 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.738695 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.738818 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.741188 (+ 2370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:42279: BlockingRecv error: recv got EOF from 127.26.52.66:42279 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:23.747534 4146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.741739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:49051)
0807 22:38:23.741964 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:23.741977 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:23.742056 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:23.742264 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:23.742267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:23.742432 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:23.742514 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.742520 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.743171 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.743174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.744038 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.744048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.744734 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.744738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.744821 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.745320 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:23.745334 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:23.747405 (+ 2071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160}
W20260807 22:38:23.747705 4006 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:23.741814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:49051 (local address 127.26.52.126:40813)
0807 22:38:23.741927 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.741930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.742033 (+ 103us) server_negotiation.cc:407] Connection header received
0807 22:38:23.742131 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.742133 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.742165 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.742227 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.742623 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.743076 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.744238 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.744612 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.744738 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.747574 (+ 2836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:49051: BlockingRecv error: recv got EOF from 127.26.52.66:49051 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 22:38:23.747942 4144 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:38:23.848901 4147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:23.849197 4147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:23.849277 4147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:23.853693 4147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:23.853773 4147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:23.853864 4147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:23.859248 4147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/krb5kdc/oryx_127.26.52.67.keytab
--principal=oryx/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:37755
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=41231
--tserver_master_addrs=127.26.52.126:40813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:23.860524 4147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:23.861575 4147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:23.871724 4153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:23.871724 4152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:23.871728 4155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:23.871982 4147 server_base.cc:1034] running on GCE node
I20260807 22:38:23.872545 4147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:23.873206 4147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:23.874365 4147 hybrid_clock.cc:648] HybridClock initialized: now 1786142303874352 us; error 25 us; skew 500 ppm
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142303, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:23.877067 4147 init.cc:377] Logged in from keytab as oryx/127.26.52.67@KRBTEST.COM (short username oryx)
I20260807 22:38:23.877974 4147 webserver.cc:460] Webserver started at http://127.26.52.67:41231/ using document root <none> and password file <none>
I20260807 22:38:23.878567 4147 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:23.878674 4147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:23.882488 4147 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 22:38:23.884557 4162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:23.885725 4147 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:23.885867 4147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "bf8dd70accd8468aa8dfa0c73616e53e"
format_stamp: "Formatted at 2026-08-07 22:38:22 on dist-test-slave-8w9v"
server_key: "e4a288b40969006dceb4532a9efe4ebd"
server_key_iv: "46845a8838a0de77db14c9c22cc294dd"
server_key_version: "encryptionkey@0"
I20260807 22:38:23.886385 4147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:23.908285 4147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:23.911183 4147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:23.911399 4147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:23.912026 4147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:23.912909 4147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:23.912982 4147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:23.913058 4147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:23.913101 4147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:23.922583 4147 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:37755
I20260807 22:38:23.922636 4279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:37755 every 8 connection(s)
I20260807 22:38:23.923640 4147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:38:23.929096 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 4147
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:38:23.935313 4006 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:23.925565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:46043 (local address 127.26.52.126:40813)
0807 22:38:23.925717 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.925720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.926557 (+ 837us) server_negotiation.cc:407] Connection header received
0807 22:38:23.927892 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.927896 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.927967 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.928076 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.929279 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.929907 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.931113 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.931337 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.931457 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.935187 (+ 3730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:46043: BlockingRecv error: recv got EOF from 127.26.52.67:46043 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:38:23.935950 4282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.925960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:46043)
0807 22:38:23.926396 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:23.926446 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:23.927680 (+ 1234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:23.928276 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:23.928283 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:23.928624 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:23.929076 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.929089 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.930075 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.930078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.930972 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.930981 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.931492 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.931496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.931675 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.932330 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:23.932351 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:23.935084 (+ 2733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":108,"threads_started":1}
W20260807 22:38:23.936558 4280 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:40813 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.52.126:40813: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
I20260807 22:38:23.939736 4284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.930192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59196 (local address 127.26.52.126:40813)
0807 22:38:23.930468 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.930471 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.930483 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:38:23.930514 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.930516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.930551 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.930653 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.931432 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.932022 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.933305 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.933663 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.933746 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.935266 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:23.935272 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:23.935287 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:23.935315 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:23.937651 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:23.938091 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:23.938098 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:23.938103 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:23.938229 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:23.938527 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:23.938531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:23.938532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:23.938878 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:23.939079 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:23.939370 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 22:38:23.939617 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":134,"threads_started":1}
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:23.942088 4282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.937001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:46877)
0807 22:38:23.937186 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:23.937198 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:23.937257 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:23.937487 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:23.937489 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:23.937616 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:23.937703 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.937707 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.938405 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.938410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.938932 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.938939 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.939370 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.939374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.939476 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.940026 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:23.940041 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:23.941958 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114}
W20260807 22:38:23.942220 4006 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:23.937105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:46877 (local address 127.26.52.126:40813)
0807 22:38:23.937228 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.937232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.937246 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:38:23.937326 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.937329 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.937374 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.937464 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.937815 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.938296 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.939045 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.939261 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.939369 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.942099 (+ 2730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:46877: BlockingRecv error: recv got EOF from 127.26.52.67:46877 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:23 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:23.947170 4282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:23.942800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:43215)
0807 22:38:23.942900 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:23.942918 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:23.942995 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:23.943183 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:23.943185 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:23.943301 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:23.943363 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.943368 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.943993 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.943996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.944543 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:23.944552 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.944932 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.944935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:23.944991 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.945409 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:23.945420 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:23.947087 (+ 1667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 22:38:23.947337 4006 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:23.942870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:43215 (local address 127.26.52.126:40813)
0807 22:38:23.943018 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:23.943021 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:23.943033 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:38:23.943061 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:23.943063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:23.943094 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:23.943156 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:23.943455 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.943908 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.944640 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:23.944840 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:23.944915 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:23.947209 (+ 2294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:43215: BlockingRecv error: recv got EOF from 127.26.52.67:43215 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 22:38:23.947543 4280 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 22:38:24 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:24 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:24.553174 4285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:24.547455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:48907)
0807 22:38:24.547728 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:24.547741 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:24.547867 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:24.548220 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:24.548222 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:24.548466 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:24.548617 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:24.548625 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.549437 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.549440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:24.550008 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:24.550016 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.550421 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.550424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:24.550482 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:24.550970 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:24.550980 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:24.552990 (+ 2010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":91,"threads_started":1}
W20260807 22:38:24.553231 4286 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:24.547515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:48907 (local address 127.26.52.126:40813)
0807 22:38:24.547772 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:24.547777 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:24.547808 (+ 31us) server_negotiation.cc:407] Connection header received
0807 22:38:24.547993 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:24.547998 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:24.548059 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:24.548190 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:24.548748 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.549340 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.550120 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.550328 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.550401 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:24.553108 (+ 2707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:48907: BlockingRecv error: recv got EOF from 127.26.52.65:48907 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":87,"threads_started":1}
Aug 07 22:38:24 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:24 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:24.754069 4287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:24.748637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:48555)
0807 22:38:24.748913 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:24.748926 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:24.749023 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:24.749213 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:24.749214 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:24.749390 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:24.749498 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:24.749504 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.750205 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.750208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:24.750770 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:24.750777 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.751190 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.751193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:24.751252 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:24.751725 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:24.751736 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:24.753944 (+ 2208us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":100,"threads_started":1}
W20260807 22:38:24.754196 4286 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:24.748700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:48555 (local address 127.26.52.126:40813)
0807 22:38:24.748843 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:24.748846 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:24.748994 (+ 148us) server_negotiation.cc:407] Connection header received
0807 22:38:24.749089 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:24.749091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:24.749135 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:24.749201 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:24.749593 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.750112 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.750871 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.751092 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.751168 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:24.754076 (+ 2908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:48555: BlockingRecv error: recv got EOF from 127.26.52.66:48555 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 22:38:24 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:24 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:24.953899 4288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:24.948221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:34597)
0807 22:38:24.948489 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:24.948503 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:24.948598 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:24.948819 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:24.948821 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:24.949014 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:24.949125 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:24.949130 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.949844 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.949846 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:24.950413 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:24.950422 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.950817 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.950820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:24.950890 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:24.951462 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:24.951474 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:24.953770 (+ 2296us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":91,"threads_started":1}
W20260807 22:38:24.954054 4286 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:24.948286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:34597 (local address 127.26.52.126:40813)
0807 22:38:24.948433 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:24.948437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:24.948550 (+ 113us) server_negotiation.cc:407] Connection header received
0807 22:38:24.948665 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:24.948667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:24.948712 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:24.948780 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:24.949228 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.949751 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.950512 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:24.950721 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:24.950797 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:24.953900 (+ 3103us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:34597: BlockingRecv error: recv got EOF from 127.26.52.67:34597 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 22:38:25 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:25 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:25.559125 4289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:25.553986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:44135)
0807 22:38:25.554255 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:25.554268 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:25.554354 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:25.554601 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:25.554604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:25.554782 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:25.554882 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:25.554887 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.555666 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.555668 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:25.556248 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:25.556257 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.556665 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.556668 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:25.556729 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:25.557294 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:25.557306 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:25.559016 (+ 1710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":88,"threads_started":1}
W20260807 22:38:25.559274 4291 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:25.554044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:44135 (local address 127.26.52.126:40813)
0807 22:38:25.554306 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:25.554310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:25.554323 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:38:25.554444 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:25.554446 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:25.554489 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:25.554566 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:25.555012 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.555568 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.556346 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.556566 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.556642 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:25.559143 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:44135: BlockingRecv error: recv got EOF from 127.26.52.65:44135 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":83,"threads_started":1}
Aug 07 22:38:25 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:25 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:25.760169 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:25.754815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:55897)
0807 22:38:25.755097 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:25.755111 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:25.755211 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:25.755423 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:25.755425 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:25.755596 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:25.755689 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:25.755695 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.756491 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.756494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:25.757034 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:25.757042 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.757435 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.757438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:25.757574 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:25.758081 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:25.758093 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:25.759994 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":88,"threads_started":1}
W20260807 22:38:25.760327 4291 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:25.754899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:55897 (local address 127.26.52.126:40813)
0807 22:38:25.755093 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:25.755098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:25.755158 (+ 60us) server_negotiation.cc:407] Connection header received
0807 22:38:25.755277 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:25.755280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:25.755322 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:25.755387 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:25.755785 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.756392 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.757130 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.757334 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.757407 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:25.760186 (+ 2779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:55897: BlockingRecv error: recv got EOF from 127.26.52.66:55897 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 07 22:38:25 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:25 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:25.963944 4293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:25.954880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:44513)
0807 22:38:25.955201 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:25.955215 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:25.955317 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:25.955568 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:25.955570 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:25.955775 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:25.955874 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:25.955902 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.956653 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.956656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:25.957329 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:25.957339 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.957824 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.957827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:25.957919 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:25.961828 (+ 3909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:25.961841 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:25.963789 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":132,"threads_started":1}
W20260807 22:38:25.964087 4291 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:25.955037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:44513 (local address 127.26.52.126:40813)
0807 22:38:25.955184 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:25.955188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:25.955285 (+ 97us) server_negotiation.cc:407] Connection header received
0807 22:38:25.955400 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:25.955403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:25.955453 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:25.955526 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:25.956011 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.956546 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.957453 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:25.957687 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:25.957944 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:25.963939 (+ 5995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:44513: BlockingRecv error: recv got EOF from 127.26.52.67:44513 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 22:38:26 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:26 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:26.565129 4294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:26.559900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:36397)
0807 22:38:26.560225 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:26.560243 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:26.560340 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:26.560565 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:26.560567 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:26.560742 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:26.560843 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:26.560848 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.561556 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.561558 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:26.562085 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:26.562092 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.562491 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.562493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:26.562551 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:26.563136 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:26.563148 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:26.564989 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":73,"threads_started":1}
W20260807 22:38:26.565251 4295 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:26.560044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:36397 (local address 127.26.52.126:40813)
0807 22:38:26.560317 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:26.560320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:26.560341 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:38:26.560409 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:26.560411 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:26.560452 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:26.560525 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:26.560950 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.561464 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.562183 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.562390 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.562462 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:26.565123 (+ 2661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:36397: BlockingRecv error: recv got EOF from 127.26.52.65:36397 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":123,"threads_started":1}
Aug 07 22:38:26 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:26 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:26.766489 4297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:26.761063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:50407)
0807 22:38:26.761336 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:26.761349 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:26.761469 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:26.761710 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:26.761712 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:26.761889 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:26.761986 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:26.761992 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.762699 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.762701 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:26.763258 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:26.763264 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.763683 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.763685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:26.763741 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:26.764326 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:26.764337 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:26.766263 (+ 1926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":76,"threads_started":1}
W20260807 22:38:26.766525 4295 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:26.761164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:50407 (local address 127.26.52.126:40813)
0807 22:38:26.761353 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:26.761357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:26.761431 (+ 74us) server_negotiation.cc:407] Connection header received
0807 22:38:26.761550 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:26.761552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:26.761598 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:26.761665 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:26.762083 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.762613 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.763350 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.763590 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.763664 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:26.766409 (+ 2745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:50407: BlockingRecv error: recv got EOF from 127.26.52.66:50407 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 22:38:26 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:26 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:26.970238 4298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:26.964752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:44883)
0807 22:38:26.965050 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:26.965083 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:26.965198 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:26.965466 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:26.965468 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:26.965643 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:26.965746 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:26.965751 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.966441 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.966444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:26.966997 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:26.967005 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.967437 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.967439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:26.967496 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:26.968052 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:26.968064 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:26.970122 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":110,"threads_started":1}
W20260807 22:38:26.970405 4295 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:26.964808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:44883 (local address 127.26.52.126:40813)
0807 22:38:26.964957 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:26.964962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:26.965247 (+ 285us) server_negotiation.cc:407] Connection header received
0807 22:38:26.965294 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:26.965297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:26.965356 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:26.965423 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:26.965837 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.966339 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.967096 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:26.967324 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:26.967407 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:26.970251 (+ 2844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:44883: BlockingRecv error: recv got EOF from 127.26.52.67:44883 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 22:38:27 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:27 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:27.572177 4300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:27.566187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:54525)
0807 22:38:27.566511 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:27.566526 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:27.566618 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:27.566862 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:27.566864 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:27.567040 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:27.567136 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:27.567141 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.568045 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.568048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:27.568991 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:27.569002 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.569614 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.569618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:27.569707 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:27.570176 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:27.570187 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:27.571990 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":128,"threads_started":1}
W20260807 22:38:27.572247 4301 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:27.566278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:54525 (local address 127.26.52.126:40813)
0807 22:38:27.566575 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:27.566579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:27.566592 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:38:27.566706 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:27.566708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:27.566751 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:27.566827 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:27.567234 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.567902 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.569108 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.569458 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.569609 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:27.572102 (+ 2493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:54525: BlockingRecv error: recv got EOF from 127.26.52.65:54525 (error 108)
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":92,"threads_started":1}
Aug 07 22:38:27 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:27 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:27.772779 4302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:27.767352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:38773)
0807 22:38:27.767639 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:27.767652 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:27.767751 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:27.768063 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:27.768066 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:27.768304 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:27.768406 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:27.768412 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.769208 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.769211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:27.769863 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:27.769872 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.770266 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.770269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:27.770328 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:27.770798 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:27.770809 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:27.772665 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":112,"threads_started":1}
W20260807 22:38:27.772898 4301 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:27.767405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:38773 (local address 127.26.52.126:40813)
0807 22:38:27.767559 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:27.767563 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:27.767717 (+ 154us) server_negotiation.cc:407] Connection header received
0807 22:38:27.767827 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:27.767829 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:27.767909 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:27.768033 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:27.768522 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.769113 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.769962 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.770172 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.770249 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:27.772779 (+ 2530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:38773: BlockingRecv error: recv got EOF from 127.26.52.66:38773 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 07 22:38:27 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:27 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:27.976538 4303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:27.971007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:36275)
0807 22:38:27.971303 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:27.971317 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:27.971462 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:27.971735 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:27.971738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:27.971948 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:27.972041 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:27.972047 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.972830 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.972835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:27.973379 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:27.973387 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.973853 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.973856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:27.973943 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:27.974472 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:27.974483 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:27.976427 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":85,"threads_started":1}
W20260807 22:38:27.976670 4301 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:27.971079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:36275 (local address 127.26.52.126:40813)
0807 22:38:27.971252 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:27.971257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:27.971392 (+ 135us) server_negotiation.cc:407] Connection header received
0807 22:38:27.971564 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:27.971568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:27.971624 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:27.971710 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:27.972180 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.972716 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.973518 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:27.973740 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:27.973840 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:27.976553 (+ 2713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:36275: BlockingRecv error: recv got EOF from 127.26.52.67:36275 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 07 22:38:28 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:28 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:28.578394 4304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:28.572930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:52295)
0807 22:38:28.573272 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:28.573286 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:28.573375 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:28.573624 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:28.573626 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:28.573798 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:28.573893 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:28.573898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.574603 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.574605 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:28.575179 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:28.575187 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.575746 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.575749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:28.575818 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:28.576398 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:28.576423 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:28.578279 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":142,"threads_started":1}
W20260807 22:38:28.578536 4305 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:28.573042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:52295 (local address 127.26.52.126:40813)
0807 22:38:28.573290 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:28.573294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:28.573333 (+ 39us) server_negotiation.cc:407] Connection header received
0807 22:38:28.573466 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:28.573468 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:28.573511 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:28.573590 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:28.573994 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.574517 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.575302 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.575625 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.575719 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:28.578409 (+ 2690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:52295: BlockingRecv error: recv got EOF from 127.26.52.65:52295 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":85,"threads_started":1}
Aug 07 22:38:28 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:28 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:28.778793 4306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:28.773631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:33905)
0807 22:38:28.773911 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:28.773935 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:28.774029 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:28.774263 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:28.774265 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:28.774466 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:28.774574 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:28.774579 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.775314 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.775317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:28.775881 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:28.775890 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.776335 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.776338 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:28.776401 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:28.776871 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:28.776882 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:28.778676 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":101,"threads_started":1}
W20260807 22:38:28.778929 4305 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:28.773778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:33905 (local address 127.26.52.126:40813)
0807 22:38:28.773920 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:28.773934 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:28.774000 (+ 66us) server_negotiation.cc:407] Connection header received
0807 22:38:28.774107 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:28.774109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:28.774153 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:28.774225 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:28.774675 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.775217 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.775998 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.776229 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.776306 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:28.778806 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:33905: BlockingRecv error: recv got EOF from 127.26.52.66:33905 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 22:38:28 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:28 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:28.982291 4307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:28.977304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:53969)
0807 22:38:28.977582 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:28.977595 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:28.977687 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:28.977906 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:28.977908 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:28.978108 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:28.978201 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:28.978207 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.978897 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.978900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:28.979482 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:28.979490 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.979891 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.979894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:28.979964 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:28.980450 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:28.980461 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:28.982155 (+ 1694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":99,"threads_started":1}
W20260807 22:38:28.982453 4305 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:28.977362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:53969 (local address 127.26.52.126:40813)
0807 22:38:28.977487 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:28.977491 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:28.977660 (+ 169us) server_negotiation.cc:407] Connection header received
0807 22:38:28.977763 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:28.977765 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:28.977809 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:28.977868 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:28.978297 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.978806 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.979587 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:28.979797 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:28.979870 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:28.982300 (+ 2430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:53969: BlockingRecv error: recv got EOF from 127.26.52.67:53969 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 22:38:29 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:29 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:29.584561 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:29.579245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:49487)
0807 22:38:29.579559 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:29.579574 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:29.579668 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:29.579892 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:29.579894 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:29.580086 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:29.580239 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:29.580246 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.580962 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.580964 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:29.581485 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:29.581492 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.582047 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.582050 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:29.582111 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:29.582663 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:29.582676 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:29.584450 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":101,"threads_started":1}
W20260807 22:38:29.584713 4309 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:29.579338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:49487 (local address 127.26.52.126:40813)
0807 22:38:29.579608 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:29.579612 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:29.579626 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:38:29.579737 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:29.579740 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:29.579781 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:29.579854 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:29.580342 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.580863 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.581579 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.581904 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.582022 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:29.584581 (+ 2559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:49487: BlockingRecv error: recv got EOF from 127.26.52.65:49487 (error 108)
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":92,"threads_started":1}
Aug 07 22:38:29 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:29 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:29.784833 4310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:29.779615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:56217)
0807 22:38:29.779880 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:29.779895 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:29.780023 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:29.780338 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:29.780340 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:29.780569 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:29.780671 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:29.780677 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.781379 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.781381 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:29.781897 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:29.781904 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.782378 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.782380 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:29.782442 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:29.782977 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:29.782989 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:29.784723 (+ 1734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":87,"threads_started":1}
W20260807 22:38:29.785074 4309 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:29.779669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:56217 (local address 127.26.52.126:40813)
0807 22:38:29.779811 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:29.779816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:29.779990 (+ 174us) server_negotiation.cc:407] Connection header received
0807 22:38:29.780145 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:29.780149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:29.780204 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:29.780292 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:29.780781 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.781288 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.782002 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.782282 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.782359 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:29.784852 (+ 2493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:56217: BlockingRecv error: recv got EOF from 127.26.52.66:56217 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 22:38:29 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:29 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:29.988309 4311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:29.983127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:50087)
0807 22:38:29.983404 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:29.983418 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:29.983518 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:29.983782 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:29.983784 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:29.983974 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:29.984070 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:29.984075 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.984858 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.984861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:29.985423 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:29.985430 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.985826 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.985829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:29.985886 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:29.986439 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:29.986453 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:29.988196 (+ 1743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":72,"threads_started":1}
W20260807 22:38:29.988448 4309 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:29.983246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:50087 (local address 127.26.52.126:40813)
0807 22:38:29.983409 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:29.983421 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:29.983519 (+ 98us) server_negotiation.cc:407] Connection header received
0807 22:38:29.983623 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:29.983626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:29.983682 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:29.983742 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:29.984240 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.984764 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.985523 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:29.985732 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:29.985805 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:29.988328 (+ 2523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:50087: BlockingRecv error: recv got EOF from 127.26.52.67:50087 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 22:38:30 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:30 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:30.591185 4312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:30.585397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:51853)
0807 22:38:30.585790 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:30.585808 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:30.585916 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:30.586141 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:30.586143 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:30.586327 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:30.586424 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:30.586430 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.587153 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.587155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:30.587819 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:30.587831 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.588482 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.588484 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:30.588582 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:30.589188 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:30.589209 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:30.591075 (+ 1866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":96,"threads_started":1}
W20260807 22:38:30.591379 4313 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:30.585468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:51853 (local address 127.26.52.126:40813)
0807 22:38:30.585737 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:30.585741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:30.585886 (+ 145us) server_negotiation.cc:407] Connection header received
0807 22:38:30.585982 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:30.585984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:30.586027 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:30.586101 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:30.586522 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.587062 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.587957 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.588338 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.588472 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:30.591237 (+ 2765us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:51853: BlockingRecv error: recv got EOF from 127.26.52.65:51853 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":91,"threads_started":1}
Aug 07 22:38:30 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:30 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:30.790925 4314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:30.785589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:42171)
0807 22:38:30.785905 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:30.785919 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:30.786029 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:30.786248 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:30.786250 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:30.786437 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:30.786537 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:30.786542 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.787247 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.787249 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:30.787841 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:30.787851 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.788273 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.788275 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:30.788335 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:30.788803 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:30.788814 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:30.790752 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":86,"threads_started":1}
W20260807 22:38:30.790946 4313 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:30.785656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:42171 (local address 127.26.52.126:40813)
0807 22:38:30.785801 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:30.785805 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:30.786000 (+ 195us) server_negotiation.cc:407] Connection header received
0807 22:38:30.786096 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:30.786098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:30.786142 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:30.786208 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:30.786636 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.787151 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.787948 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.788177 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.788254 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:30.790847 (+ 2593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:42171: BlockingRecv error: recv got EOF from 127.26.52.66:42171 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 22:38:30 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:30 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:30.999147 4315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:30.989139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:58413)
0807 22:38:30.989478 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:30.989492 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:30.989588 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:30.989795 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:30.989797 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:30.989973 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:30.990105 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:30.990113 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.990890 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.990894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:30.991443 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:30.991451 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.991919 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.991923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:30.992004 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:30.996901 (+ 4897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:30.996916 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:30.999031 (+ 2115us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":113,"threads_started":1}
W20260807 22:38:30.999424 4313 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:30.989210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:58413 (local address 127.26.52.126:40813)
0807 22:38:30.989385 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:30.989390 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:30.989563 (+ 173us) server_negotiation.cc:407] Connection header received
0807 22:38:30.989666 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:30.989668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:30.989716 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:30.989784 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:30.990245 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.990778 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.991564 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:30.991804 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:30.991922 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:30.999170 (+ 7248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:58413: BlockingRecv error: recv got EOF from 127.26.52.67:58413 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 07 22:38:31 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:31 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:31.597936 4316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:31.591913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:48489)
0807 22:38:31.592233 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:31.592271 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:31.592385 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:31.592681 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:31.592683 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:31.592908 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:31.593056 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:31.593065 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:31.593980 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:31.593985 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:31.594667 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:31.594677 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:31.595154 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:31.595158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:31.595244 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:31.595819 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:31.595831 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:31.597764 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":85,"threads_started":1}
W20260807 22:38:31.598022 4317 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:31.592079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:48489 (local address 127.26.52.126:40813)
0807 22:38:31.592346 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:31.592350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:31.592363 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:38:31.592500 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:31.592504 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:31.592560 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:31.592654 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:31.593206 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:31.593871 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:31.594795 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:31.595035 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:31.595140 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:31.597884 (+ 2744us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:48489: BlockingRecv error: recv got EOF from 127.26.52.65:48489 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":95,"threads_started":1}
Aug 07 22:38:31 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:31 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:31.797667 4318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:31.791698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:60451)
0807 22:38:31.792042 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:31.792059 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:31.792229 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:31.792560 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:31.792565 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:31.792823 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:31.792975 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:31.792983 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:31.793947 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:31.793950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:31.794547 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:31.794588 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:31.795117 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:31.795121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:31.795201 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:31.795670 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:31.795681 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:31.797548 (+ 1867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":102,"threads_started":1}
W20260807 22:38:31.797801 4317 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:31.791825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:60451 (local address 127.26.52.126:40813)
0807 22:38:31.791993 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:31.792001 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:31.792168 (+ 167us) server_negotiation.cc:407] Connection header received
0807 22:38:31.792328 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:31.792331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:31.792387 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:31.792505 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:31.793068 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:31.793841 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:31.794725 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:31.794996 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:31.795109 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:31.797684 (+ 2575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:60451: BlockingRecv error: recv got EOF from 127.26.52.66:60451 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 22:38:32 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:32 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:32.008051 4319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:31.999988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:51295)
0807 22:38:32.000922 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:32.000938 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:32.001053 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:32.001891 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:32.001894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:32.002123 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:32.002233 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:32.002240 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.003271 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.003275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:32.004215 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:32.004231 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.004727 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.004730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:32.004815 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:32.005421 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:32.005438 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:32.007851 (+ 2413us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":835,"thread_start_us":513,"threads_started":1}
W20260807 22:38:32.008262 4317 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:32.000099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:51295 (local address 127.26.52.126:40813)
0807 22:38:32.001615 (+ 1516us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:32.001622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:32.001641 (+ 19us) server_negotiation.cc:407] Connection header received
0807 22:38:32.001690 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:32.001695 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:32.001761 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:32.001848 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:32.002362 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.003157 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.004352 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.004605 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.004720 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:32.008088 (+ 3368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:51295: BlockingRecv error: recv got EOF from 127.26.52.67:51295 (error 108)
Metrics: {"server-negotiator.queue_time_us":567}
Aug 07 22:38:32 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:32 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:32.603909 4320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:32.598766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:55627)
0807 22:38:32.599048 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:32.599061 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:32.599149 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:32.599394 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:32.599396 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:32.599582 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:32.599680 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:32.599685 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.600424 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.600427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:32.600973 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:32.600980 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.601395 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.601397 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:32.601472 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:32.601938 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:32.601949 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:32.603774 (+ 1825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":96,"threads_started":1}
W20260807 22:38:32.604128 4321 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:32.598839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:55627 (local address 127.26.52.126:40813)
0807 22:38:32.599082 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:32.599086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:32.599100 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:38:32.599238 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:32.599240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:32.599284 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:32.599358 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:32.599775 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.600331 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.601080 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.601299 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.601373 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:32.603980 (+ 2607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:55627: BlockingRecv error: recv got EOF from 127.26.52.65:55627 (error 108)
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":71,"threads_started":1}
Aug 07 22:38:32 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:32 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:32.804209 4322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:32.798525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:37547)
0807 22:38:32.798838 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:32.798851 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:32.798999 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:32.799340 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:32.799343 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:32.799574 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:32.799676 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:32.799703 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.800524 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.800527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:32.801075 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:32.801083 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.801479 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.801481 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:32.801539 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:32.802028 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:32.802040 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:32.803984 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":129,"threads_started":1}
W20260807 22:38:32.804261 4321 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:32.798587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:37547 (local address 127.26.52.126:40813)
0807 22:38:32.798749 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:32.798757 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:32.798934 (+ 177us) server_negotiation.cc:407] Connection header received
0807 22:38:32.799120 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:32.799122 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:32.799168 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:32.799278 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:32.799808 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.800423 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.801175 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:32.801383 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:32.801457 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:32.804148 (+ 2691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:37547: BlockingRecv error: recv got EOF from 127.26.52.66:37547 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 22:38:33 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:33 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:33.014134 4323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:33.009038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:35201)
0807 22:38:33.009290 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:33.009306 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:33.009412 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:33.009650 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:33.009652 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:33.009822 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:33.009917 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:33.009922 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.010622 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.010624 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:33.011160 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:33.011167 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.011603 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.011606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:33.011665 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:33.012161 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:33.012173 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:33.014021 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":94,"threads_started":1}
W20260807 22:38:33.014299 4321 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:33.009143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:35201 (local address 127.26.52.126:40813)
0807 22:38:33.009281 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:33.009285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:33.009383 (+ 98us) server_negotiation.cc:407] Connection header received
0807 22:38:33.009499 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:33.009501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:33.009546 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:33.009614 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:33.010013 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.010531 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.011265 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.011503 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.011581 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:33.014147 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:35201: BlockingRecv error: recv got EOF from 127.26.52.67:35201 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 22:38:33 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:33 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:33.610628 4324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:33.604877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:47435)
0807 22:38:33.605191 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:33.605205 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:33.605335 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:33.605686 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:33.605689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:33.605893 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:33.606036 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:33.606044 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.607073 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.607076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:33.607691 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:33.607703 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.608182 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.608186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:33.608254 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:33.608737 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:33.608749 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:33.610510 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":86,"threads_started":1}
W20260807 22:38:33.610772 4325 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:33.604989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:47435 (local address 127.26.52.126:40813)
0807 22:38:33.605231 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:33.605235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:33.605252 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:38:33.605460 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:33.605463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:33.605524 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:33.605618 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:33.606171 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.606961 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.607816 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.608031 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.608103 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:33.610641 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:47435: BlockingRecv error: recv got EOF from 127.26.52.65:47435 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":60,"threads_started":1}
Aug 07 22:38:33 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:33 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:33.810542 4326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:33.805277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:54965)
0807 22:38:33.805572 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:33.805584 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:33.805673 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:33.805915 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:33.805918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:33.806125 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:33.806220 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:33.806225 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.806935 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.806937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:33.807496 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:33.807503 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.807889 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.807891 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:33.807945 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:33.808510 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:33.808522 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:33.810371 (+ 1849us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":95,"threads_started":1}
W20260807 22:38:33.810616 4325 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:33.805364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:54965 (local address 127.26.52.126:40813)
0807 22:38:33.805530 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:33.805534 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:33.805636 (+ 102us) server_negotiation.cc:407] Connection header received
0807 22:38:33.805738 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:33.805741 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:33.805802 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:33.805873 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:33.806323 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.806843 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.807594 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:33.807797 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:33.807868 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:33.810508 (+ 2640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:54965: BlockingRecv error: recv got EOF from 127.26.52.66:54965 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 22:38:34 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:34 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:34.020272 4327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:34.015031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:55641)
0807 22:38:34.015321 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:34.015336 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:34.015450 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:34.015703 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:34.015705 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:34.015888 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:34.015997 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:34.016002 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.016730 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.016732 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:34.017272 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:34.017279 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.017671 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.017674 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:34.017735 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:34.018216 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:34.018227 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:34.020071 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":103,"threads_started":1}
W20260807 22:38:34.020524 4325 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:34.015189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:55641 (local address 127.26.52.126:40813)
0807 22:38:34.015325 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:34.015329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:34.015400 (+ 71us) server_negotiation.cc:407] Connection header received
0807 22:38:34.015533 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:34.015535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:34.015583 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:34.015659 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:34.016099 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.016637 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.017365 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.017572 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.017645 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:34.020278 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:55641: BlockingRecv error: recv got EOF from 127.26.52.67:55641 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 22:38:34 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:34 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:34.617198 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:34.611519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:34641)
0807 22:38:34.611789 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:34.611802 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:34.611893 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:34.612290 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:34.612296 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:34.612501 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:34.612603 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:34.612609 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.613654 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.613657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:34.614214 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:34.614223 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.614632 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.614634 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:34.614694 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:34.615238 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:34.615251 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:34.617080 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":88,"threads_started":1}
W20260807 22:38:34.617383 4329 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:34.611664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:34641 (local address 127.26.52.126:40813)
0807 22:38:34.611979 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:34.611983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:34.612001 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:38:34.612051 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:34.612053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:34.612118 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:34.612245 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:34.612714 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.613542 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.614316 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.614537 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.614612 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:34.617210 (+ 2598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:34641: BlockingRecv error: recv got EOF from 127.26.52.65:34641 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":100,"threads_started":1}
Aug 07 22:38:34 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:34 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:34.816376 4330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:34.811283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:43825)
0807 22:38:34.811552 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:34.811565 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:34.811662 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:34.811844 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:34.811846 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:34.812022 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:34.812170 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:34.812184 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.812881 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.812883 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:34.813433 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:34.813440 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.813835 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.813838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:34.813898 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:34.814366 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:34.814377 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:34.816258 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":95,"threads_started":1}
W20260807 22:38:34.816582 4329 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:34.811377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:43825 (local address 127.26.52.126:40813)
0807 22:38:34.811541 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:34.811545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:34.811612 (+ 67us) server_negotiation.cc:407] Connection header received
0807 22:38:34.811725 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:34.811727 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:34.811767 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:34.811833 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:34.812274 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.812789 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.813528 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:34.813739 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:34.813812 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:34.816442 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:43825: BlockingRecv error: recv got EOF from 127.26.52.66:43825 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 07 22:38:35 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:35 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:35.026603 4331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:35.021053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:35545)
0807 22:38:35.021347 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:35.021361 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:35.021465 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:35.021702 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:35.021704 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:35.021904 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:35.022004 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:35.022010 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.022716 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.022719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:35.023277 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:35.023284 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.023681 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.023683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:35.023750 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:35.024301 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:35.024313 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:35.026474 (+ 2161us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":113,"threads_started":1}
W20260807 22:38:35.026692 4329 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:35.021123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:35545 (local address 127.26.52.126:40813)
0807 22:38:35.021256 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:35.021260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:35.021425 (+ 165us) server_negotiation.cc:407] Connection header received
0807 22:38:35.021543 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:35.021546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:35.021591 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:35.021659 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:35.022100 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.022617 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.023373 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.023581 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.023654 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:35.026601 (+ 2947us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:35545: BlockingRecv error: recv got EOF from 127.26.52.67:35545 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 22:38:35 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:35 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:35.623236 4332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:35.618014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:58929)
0807 22:38:35.618293 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:35.618307 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:35.618394 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:35.618641 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:35.618643 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:35.618829 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:35.618943 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:35.618949 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.619667 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.619669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:35.620287 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:35.620297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.620702 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.620705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:35.620767 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:35.621246 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:35.621258 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:35.623115 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":99,"threads_started":1}
W20260807 22:38:35.623490 4333 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:35.618088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:58929 (local address 127.26.52.126:40813)
0807 22:38:35.618326 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:35.618330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:35.618345 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:38:35.618478 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:35.618480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:35.618525 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:35.618602 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:35.619040 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.619575 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.620383 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.620606 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.620684 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:35.623249 (+ 2565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:58929: BlockingRecv error: recv got EOF from 127.26.52.65:58929 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":89,"threads_started":1}
Aug 07 22:38:35 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:35 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:35.822803 4334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:35.817202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:45709)
0807 22:38:35.817495 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:35.817517 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:35.817657 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:35.817951 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:35.817954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:35.818155 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:35.818266 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:35.818271 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.819030 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.819034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:35.819601 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:35.819609 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.820092 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.820096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:35.820210 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:35.820722 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:35.820734 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:35.822685 (+ 1951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":87,"threads_started":1}
W20260807 22:38:35.822973 4333 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:35.817276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:45709 (local address 127.26.52.126:40813)
0807 22:38:35.817462 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:35.817466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:35.817593 (+ 127us) server_negotiation.cc:407] Connection header received
0807 22:38:35.817773 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:35.817777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:35.817832 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:35.817918 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:35.818382 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.818915 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.819750 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:35.819976 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:35.820086 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:35.822815 (+ 2729us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:45709: BlockingRecv error: recv got EOF from 127.26.52.66:45709 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 22:38:36 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:36 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:36.036715 4335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:36.027628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:56275)
0807 22:38:36.027967 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:36.027982 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:36.028152 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:36.028487 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:36.028489 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:36.028668 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:36.028769 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:36.028774 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.029527 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.029530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:36.030094 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:36.030100 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.030521 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.030525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:36.030609 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:36.034723 (+ 4114us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:36.034735 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:36.036596 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":94,"threads_started":1}
W20260807 22:38:36.036898 4333 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:36.027703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:56275 (local address 127.26.52.126:40813)
0807 22:38:36.027857 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:36.027862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:36.028067 (+ 205us) server_negotiation.cc:407] Connection header received
0807 22:38:36.028277 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:36.028281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:36.028348 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:36.028453 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:36.028880 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.029423 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.030187 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.030406 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.030515 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:36.036738 (+ 6223us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:56275: BlockingRecv error: recv got EOF from 127.26.52.67:56275 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 22:38:36 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:36 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:36.629304 4336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:36.623956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:40047)
0807 22:38:36.624308 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:36.624321 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:36.624406 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:36.624671 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:36.624673 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:36.624849 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:36.624948 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:36.624953 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.625678 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.625680 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:36.626221 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:36.626229 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.626637 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.626639 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:36.626702 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:36.627166 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:36.627178 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:36.629135 (+ 1957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":89,"threads_started":1}
W20260807 22:38:36.629462 4337 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:36.624075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:40047 (local address 127.26.52.126:40813)
0807 22:38:36.624346 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:36.624349 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:36.624380 (+ 31us) server_negotiation.cc:407] Connection header received
0807 22:38:36.624514 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:36.624516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:36.624559 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:36.624627 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:36.625050 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.625560 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.626322 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.626540 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.626616 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:36.629318 (+ 2702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:40047: BlockingRecv error: recv got EOF from 127.26.52.65:40047 (error 108)
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":84,"threads_started":1}
Aug 07 22:38:36 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:36 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:36.829258 4338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:36.823711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:41225)
0807 22:38:36.824001 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:36.824015 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:36.824105 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:36.824395 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:36.824397 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:36.824580 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:36.824729 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:36.824738 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.825754 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.825757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:36.826378 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:36.826387 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.826800 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.826803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:36.826860 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:36.827346 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:36.827357 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:36.829137 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":97,"threads_started":1}
W20260807 22:38:36.829388 4337 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:36.823882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:41225 (local address 127.26.52.126:40813)
0807 22:38:36.824047 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:36.824050 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:36.824064 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:38:36.824229 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:36.824232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:36.824279 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:36.824355 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:36.824867 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.825624 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.826490 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:36.826706 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:36.826783 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:36.829270 (+ 2487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:41225: BlockingRecv error: recv got EOF from 127.26.52.66:41225 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 07 22:38:37 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:37 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:37.042474 4339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:37.037500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:38409)
0807 22:38:37.037794 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:37.037808 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:37.037904 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:37.038143 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:37.038145 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:37.038323 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:37.038417 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:37.038435 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.039137 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.039139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:37.039689 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:37.039695 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.040096 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.040098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:37.040227 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:37.040680 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:37.040691 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:37.042351 (+ 1660us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":128,"threads_started":1}
W20260807 22:38:37.042721 4337 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:37.037574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:38409 (local address 127.26.52.126:40813)
0807 22:38:37.037737 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:37.037742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:37.037877 (+ 135us) server_negotiation.cc:407] Connection header received
0807 22:38:37.037971 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:37.037973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:37.038039 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:37.038111 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:37.038535 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.039048 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.039787 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.039993 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.040076 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:37.042488 (+ 2412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:38409: BlockingRecv error: recv got EOF from 127.26.52.67:38409 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 07 22:38:37 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:37 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:37.635727 4340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:37.630109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:41305)
0807 22:38:37.630390 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:37.630403 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:37.630506 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:37.630746 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:37.630748 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:37.630942 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:37.631058 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:37.631063 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.632161 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.632165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:37.632802 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:37.632813 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.633236 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.633238 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:37.633300 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:37.633849 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:37.633861 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:37.635599 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":92,"threads_started":1}
W20260807 22:38:37.635862 4341 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:37.630182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:41305 (local address 127.26.52.126:40813)
0807 22:38:37.630515 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:37.630519 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:37.630563 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:38:37.630598 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:37.630601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:37.630643 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:37.630710 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:37.631188 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.631997 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.632912 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.633138 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.633219 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:37.635729 (+ 2510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:41305: BlockingRecv error: recv got EOF from 127.26.52.65:41305 (error 108)
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":71,"threads_started":1}
Aug 07 22:38:37 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:37 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:37.835677 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:37.830145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:50843)
0807 22:38:37.830520 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:37.830532 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:37.830665 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:37.830970 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:37.830973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:37.831185 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:37.831280 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:37.831286 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.832055 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.832060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:37.832667 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:37.832676 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.833144 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.833148 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:37.833238 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:37.833722 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:37.833733 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:37.835553 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":123,"threads_started":1}
W20260807 22:38:37.835922 4341 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:37.830227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:50843 (local address 127.26.52.126:40813)
0807 22:38:37.830415 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:37.830420 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:37.830608 (+ 188us) server_negotiation.cc:407] Connection header received
0807 22:38:37.830783 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:37.830787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:37.830842 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:37.830937 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:37.831404 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.831937 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.832794 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:37.833025 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:37.833139 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:37.835687 (+ 2548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:50843: BlockingRecv error: recv got EOF from 127.26.52.66:50843 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 07 22:38:38 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:38 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.67@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:38.049141 4343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:38.043498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.67:36927)
0807 22:38:38.043806 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:38.043820 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:38.043950 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:38.044267 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:38.044271 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:38.044504 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:38.044633 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:38.044640 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.045526 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.045528 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:38.046078 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:38.046086 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.046492 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.046495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:38.046551 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:38.047027 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:38.047038 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:38.049027 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":104,"threads_started":1}
W20260807 22:38:38.049331 4341 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:38.043573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:36927 (local address 127.26.52.126:40813)
0807 22:38:38.043711 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:38.043717 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:38.043881 (+ 164us) server_negotiation.cc:407] Connection header received
0807 22:38:38.044037 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:38.044040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:38.044130 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:38.044234 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:38.044770 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.045407 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.046185 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.046398 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.046471 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:38.049169 (+ 2698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.67:36927: BlockingRecv error: recv got EOF from 127.26.52.67:36927 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 22:38:38 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:38 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.65@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:38.641710 4344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:38.636671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.65:58837)
0807 22:38:38.636947 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:38.636961 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:38.637045 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:38.637303 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:38.637305 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:38.637491 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:38.637589 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:38.637594 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.638283 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.638285 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:38.638837 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:38.638846 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.639261 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.639263 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:38.639321 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:38.639808 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:38.639819 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:38.641584 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":87,"threads_started":1}
W20260807 22:38:38.641853 4345 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:38.636732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:58837 (local address 127.26.52.126:40813)
0807 22:38:38.636983 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:38.636987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:38.637004 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:38:38.637134 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:38.637136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:38.637194 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:38.637268 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:38.637687 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.638191 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.638933 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.639168 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.639241 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:38.641720 (+ 2479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.65:58837: BlockingRecv error: recv got EOF from 127.26.52.65:58837 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":60,"threads_started":1}
Aug 07 22:38:38 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:38:38 dist-test-slave-8w9v krb5kdc[3231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.52.66@KRBTEST.COM for oryx/127.26.52.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:38:38.842175 4346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:38.836653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40813 (local address 127.26.52.66:44839)
0807 22:38:38.836925 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:38.836939 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:38.837028 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:38.837249 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:38.837251 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:38.837446 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:38.837540 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:38.837546 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.838253 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.838255 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:38.838813 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:38.838819 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.839241 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.839244 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:38.839300 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:38.839788 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:38.839799 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:38.842007 (+ 2208us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.52.126:40813: Server oryx/127.26.52.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":100,"threads_started":1}
W20260807 22:38:38.842296 4345 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:38.836754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:44839 (local address 127.26.52.126:40813)
0807 22:38:38.836900 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:38.836904 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:38.837007 (+ 103us) server_negotiation.cc:407] Connection header received
0807 22:38:38.837095 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:38.837097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:38.837139 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:38.837210 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:38.837643 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.838161 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.838914 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:38.839141 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:38.839221 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:38.842167 (+ 2946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.52.66:44839: BlockingRecv error: recv got EOF from 127.26.52.66:44839 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:38:38.931561 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 3844
I20260807 22:38:38.940804 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 4008
I20260807 22:38:38.947908 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 4147
I20260807 22:38:38.954592 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 3769
2026-08-07T22:38:38Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18057 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T22:38:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:38Z Disabled control of system clock
I20260807 22:38:38.988301 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40605
--webserver_interface=127.26.52.126
--webserver_port=0
--builtin_ntp_servers=127.26.52.84:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:40605
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 22:38:39.101182 4351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:39.101456 4351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:39.101493 4351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:39.105660 4351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:39.105721 4351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:39.105739 4351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:39.105760 4351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:39.105778 4351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:39.110424 4351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:40605
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:39.111442 4351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:39.112838 4351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:39.121946 4359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:39.122061 4351 server_base.cc:1034] running on GCE node
W20260807 22:38:39.122023 4356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:39.121960 4357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:39.122766 4351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:39.123755 4351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:39.124922 4351 hybrid_clock.cc:648] HybridClock initialized: now 1786142319124899 us; error 33 us; skew 500 ppm
I20260807 22:38:39.126652 4351 webserver.cc:460] Webserver started at http://127.26.52.126:35897/ using document root <none> and password file <none>
I20260807 22:38:39.127231 4351 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:39.127291 4351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:39.127542 4351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:39.129545 4351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "23330037e437426a88f819c4383b5a35"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "7ec11e32134269d369c565a22a047f54"
server_key_iv: "c3c183aa2792333c4cccbc8409ff8947"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.130096 4351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "23330037e437426a88f819c4383b5a35"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "7ec11e32134269d369c565a22a047f54"
server_key_iv: "c3c183aa2792333c4cccbc8409ff8947"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.133610 4351 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:38:39.135779 4365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:39.136958 4351 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:39.137104 4351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "23330037e437426a88f819c4383b5a35"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "7ec11e32134269d369c565a22a047f54"
server_key_iv: "c3c183aa2792333c4cccbc8409ff8947"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.137209 4351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:39.171198 4351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:39.172001 4351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:39.172276 4351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:39.179416 4351 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:40605
I20260807 22:38:39.179455 4420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:40605 every 8 connection(s)
I20260807 22:38:39.180449 4351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:39.183673 4421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:39.184417 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 4351
I20260807 22:38:39.184561 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:39.184911 26833 external_mini_cluster.cc:1428] Setting key 54eb3418396843f943ef4f88002e557e
I20260807 22:38:39.189934 4421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35: Bootstrap starting.
I20260807 22:38:39.192257 4421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:39.193032 4421 log.cc:824] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:39.194309 4424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:39.186408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48814 (local address 127.26.52.126:40605)
0807 22:38:39.187051 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:39.187065 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:39.187113 (+ 48us) server_negotiation.cc:407] Connection header received
0807 22:38:39.187766 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:39.187781 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:39.188217 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:39.188548 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:39.188968 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.189910 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.190786 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.191220 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.191379 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:39.192303 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:39.192308 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:39.192319 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:39.192797 (+ 478us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:39.192849 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:39.192868 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:39.193008 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:39.193162 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 22:38:39.193410 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":122,"threads_started":1}
I20260807 22:38:39.195266 4421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35: No bootstrap required, opened a new log
I20260807 22:38:39.198841 4421 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23330037e437426a88f819c4383b5a35" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40605 } }
I20260807 22:38:39.199051 4421 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:39.199127 4421 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23330037e437426a88f819c4383b5a35, State: Initialized, Role: FOLLOWER
I20260807 22:38:39.199563 4421 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23330037e437426a88f819c4383b5a35" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40605 } }
I20260807 22:38:39.199719 4421 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:39.199787 4421 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:39.199884 4421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:39.200953 4421 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23330037e437426a88f819c4383b5a35" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40605 } }
I20260807 22:38:39.201298 4421 leader_election.cc:302] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23330037e437426a88f819c4383b5a35; no voters:
I20260807 22:38:39.201596 4421 leader_election.cc:288] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:39.201730 4426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:39.202010 4426 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [term 1 LEADER]: Becoming Leader. State: Replica: 23330037e437426a88f819c4383b5a35, State: Running, Role: LEADER
I20260807 22:38:39.202334 4426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23330037e437426a88f819c4383b5a35" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40605 } }
I20260807 22:38:39.202801 4421 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:39.203907 4428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23330037e437426a88f819c4383b5a35. Latest consensus state: current_term: 1 leader_uuid: "23330037e437426a88f819c4383b5a35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23330037e437426a88f819c4383b5a35" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40605 } } }
I20260807 22:38:39.204047 4428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:39.204406 4427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23330037e437426a88f819c4383b5a35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23330037e437426a88f819c4383b5a35" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40605 } } }
I20260807 22:38:39.204473 4436 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:39.204550 4427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:39.207655 4436 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:39.212944 4436 catalog_manager.cc:1347] Generated new cluster ID: 383f510d54714244831b5fd1fa1421e0
I20260807 22:38:39.213012 4436 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:39.225173 4436 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:39.226037 4436 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:39.231395 4436 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23330037e437426a88f819c4383b5a35: Generated new TSK 0
I20260807 22:38:39.232035 4436 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:38:39.239328 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40605
--builtin_ntp_servers=127.26.52.84:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 22:38:39.353200 4446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:39.353446 4446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:39.353482 4446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:39.357551 4446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:39.357602 4446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:39.357687 4446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:39.362322 4446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:39.363355 4446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:39.364768 4446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:39.374203 4451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:39.374214 4455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:39.374244 4452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:39.374571 4446 server_base.cc:1034] running on GCE node
I20260807 22:38:39.374975 4446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:39.375640 4446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:39.376819 4446 hybrid_clock.cc:648] HybridClock initialized: now 1786142319376805 us; error 24 us; skew 500 ppm
I20260807 22:38:39.378593 4446 webserver.cc:460] Webserver started at http://127.26.52.65:37449/ using document root <none> and password file <none>
I20260807 22:38:39.379191 4446 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:39.379284 4446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:39.379525 4446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:39.381605 4446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "fd7fa8cef9f540deb1cf72691ee7839c"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "062dde94c507ee01020467a37e3fd0ca"
server_key_iv: "d01f7bd7f7005b0157b89adc572891a9"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.382169 4446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "fd7fa8cef9f540deb1cf72691ee7839c"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "062dde94c507ee01020467a37e3fd0ca"
server_key_iv: "d01f7bd7f7005b0157b89adc572891a9"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.385809 4446 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 22:38:39.388427 4461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:39.389647 4446 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:38:39.389741 4446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "fd7fa8cef9f540deb1cf72691ee7839c"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "062dde94c507ee01020467a37e3fd0ca"
server_key_iv: "d01f7bd7f7005b0157b89adc572891a9"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.389827 4446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:39.409399 4446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:39.410075 4446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:39.410238 4446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:39.410777 4446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:39.411690 4446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:39.411736 4446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:39.411778 4446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:39.411798 4446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:39.421060 4446 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:34067
I20260807 22:38:39.421097 4579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:34067 every 8 connection(s)
I20260807 22:38:39.421939 4446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:39.426568 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 4446
I20260807 22:38:39.426694 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:38:39.426994 26833 external_mini_cluster.cc:1428] Setting key 2c07f4beef2dc42b282e4d895415fae0
I20260807 22:38:39.428897 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40605
--builtin_ntp_servers=127.26.52.84:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 22:38:39.431679 4424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:39.423691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:42765 (local address 127.26.52.126:40605)
0807 22:38:39.423844 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:39.423849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:39.424897 (+ 1048us) server_negotiation.cc:407] Connection header received
0807 22:38:39.426509 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:39.426513 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:39.426574 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:39.426677 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:39.427703 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.428348 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.429566 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.429949 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.430077 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:39.431157 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:39.431161 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:39.431163 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:39.431177 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:39.431200 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:39.431214 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:39.431291 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:39.431469 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 22:38:39.431535 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:38:39.432889 4582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:39.424090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40605 (local address 127.26.52.65:42765)
0807 22:38:39.424759 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:39.424797 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:39.426299 (+ 1502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:39.426872 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:39.426878 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:39.426955 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:39.427571 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:39.427588 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.428486 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.428488 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:39.429446 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:39.429456 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.430097 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.430100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:39.430235 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:39.430898 (+ 663us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:39.430900 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:39.430939 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:39.431000 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:39.431306 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:39.431318 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:39.431328 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 22:38:39.431466 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 22:38:39.431734 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":106,"threads_started":1}
I20260807 22:38:39.434227 4580 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40605
I20260807 22:38:39.434494 4580 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:39.435137 4580 heartbeater.cc:511] Master 127.26.52.126:40605 requested a full tablet report, sending...
I20260807 22:38:39.436951 4383 ts_manager.cc:194] Registered new tserver with Master: fd7fa8cef9f540deb1cf72691ee7839c (127.26.52.65:34067)
I20260807 22:38:39.438733 4383 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.65:42765
W20260807 22:38:39.545298 4583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:39.545579 4583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:39.545646 4583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:39.549614 4583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:39.549664 4583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:39.549718 4583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:39.554319 4583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:39.555284 4583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:39.557291 4583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:39.567078 4588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:39.567070 4591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:39.567131 4589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:39.567303 4583 server_base.cc:1034] running on GCE node
I20260807 22:38:39.567701 4583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:39.568331 4583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:39.569487 4583 hybrid_clock.cc:648] HybridClock initialized: now 1786142319569472 us; error 61 us; skew 500 ppm
I20260807 22:38:39.571429 4583 webserver.cc:460] Webserver started at http://127.26.52.66:33271/ using document root <none> and password file <none>
I20260807 22:38:39.572031 4583 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:39.572093 4583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:39.572386 4583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:39.574407 4583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "ba8166aadc184a9785e662bb9fe22f45"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "0132debe97d6e041b41cefade7861567"
server_key_iv: "69c0741e5ccba4db836c06b0e4807bd6"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.574970 4583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "ba8166aadc184a9785e662bb9fe22f45"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "0132debe97d6e041b41cefade7861567"
server_key_iv: "69c0741e5ccba4db836c06b0e4807bd6"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.578641 4583 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260807 22:38:39.581180 4597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:39.582337 4583 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:38:39.582486 4583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "ba8166aadc184a9785e662bb9fe22f45"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "0132debe97d6e041b41cefade7861567"
server_key_iv: "69c0741e5ccba4db836c06b0e4807bd6"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.582602 4583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:39.593928 4583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:39.594535 4583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:39.594722 4583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:39.595270 4583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:39.596212 4583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:39.596287 4583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:39.596350 4583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:39.596402 4583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:39.605408 4583 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:42963
I20260807 22:38:39.605440 4717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:42963 every 8 connection(s)
I20260807 22:38:39.606346 4583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:39.606842 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 4583
I20260807 22:38:39.606984 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:38:39.607369 26833 external_mini_cluster.cc:1428] Setting key 2b18f494bdfcca6b9e36c587cdac3f4d
I20260807 22:38:39.609453 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40605
--builtin_ntp_servers=127.26.52.84:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 22:38:39.615499 4424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:39.608195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:36061 (local address 127.26.52.126:40605)
0807 22:38:39.608316 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:39.608319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:39.609570 (+ 1251us) server_negotiation.cc:407] Connection header received
0807 22:38:39.610942 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:39.610945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:39.610998 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:39.611083 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:39.611927 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.612485 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.613609 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.613823 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.613933 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:39.615001 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:39.615005 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:39.615008 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:39.615028 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:39.615047 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:39.615054 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:39.615130 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:39.615285 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 22:38:39.615348 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:38:39.616328 4720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:39.608730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40605 (local address 127.26.52.66:36061)
0807 22:38:39.609428 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:39.609477 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:39.610742 (+ 1265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:39.611267 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:39.611273 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:39.611350 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:39.611792 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:39.611803 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.612616 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.612619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:39.613477 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:39.613486 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.613995 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.614001 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:39.614152 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:39.614743 (+ 591us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:39.614744 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:39.614781 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:39.614840 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:39.615144 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:39.615154 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:39.615164 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 22:38:39.615283 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 22:38:39.615538 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":145,"threads_started":1}
I20260807 22:38:39.617408 4718 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40605
I20260807 22:38:39.617668 4718 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:39.618319 4718 heartbeater.cc:511] Master 127.26.52.126:40605 requested a full tablet report, sending...
I20260807 22:38:39.619495 4383 ts_manager.cc:194] Registered new tserver with Master: ba8166aadc184a9785e662bb9fe22f45 (127.26.52.66:42963)
I20260807 22:38:39.620064 4383 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.66:36061
W20260807 22:38:39.722321 4721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:39.722604 4721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:39.722678 4721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:39.726769 4721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:39.726851 4721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:39.726939 4721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:39.731851 4721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:39.733019 4721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:39.734463 4721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:39.744189 4726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:39.744267 4727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:39.744189 4729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:39.744891 4721 server_base.cc:1034] running on GCE node
I20260807 22:38:39.745324 4721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:39.746188 4721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:39.749516 4721 hybrid_clock.cc:648] HybridClock initialized: now 1786142319749483 us; error 47 us; skew 500 ppm
I20260807 22:38:39.751643 4721 webserver.cc:460] Webserver started at http://127.26.52.67:34291/ using document root <none> and password file <none>
I20260807 22:38:39.752283 4721 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:39.752351 4721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:39.752580 4721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:39.754593 4721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "1f43450c4c7443cea036fb039bea3518"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "6451b8c8179b91d3662c1b5aeb12e7b4"
server_key_iv: "c3f13bcbd143a6d54303e10f1ce4c0f9"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.755153 4721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "1f43450c4c7443cea036fb039bea3518"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "6451b8c8179b91d3662c1b5aeb12e7b4"
server_key_iv: "c3f13bcbd143a6d54303e10f1ce4c0f9"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.758879 4721 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:38:39.761384 4735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:39.762552 4721 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:38:39.762684 4721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "1f43450c4c7443cea036fb039bea3518"
format_stamp: "Formatted at 2026-08-07 22:38:39 on dist-test-slave-8w9v"
server_key: "6451b8c8179b91d3662c1b5aeb12e7b4"
server_key_iv: "c3f13bcbd143a6d54303e10f1ce4c0f9"
server_key_version: "encryptionkey@0"
I20260807 22:38:39.762795 4721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:39.778332 4721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:39.778995 4721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:39.779198 4721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:39.779814 4721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:39.780803 4721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:39.780874 4721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:39.780938 4721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:39.780994 4721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:39.790267 4721 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:39631
I20260807 22:38:39.790292 4853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:39631 every 8 connection(s)
I20260807 22:38:39.791134 4721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:38:39.796268 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 4721
I20260807 22:38:39.796381 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:38:39.796694 26833 external_mini_cluster.cc:1428] Setting key 4e7b92e23db1bbf94c063170c138cd9e
I20260807 22:38:39.800438 4424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:39.792907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:33137 (local address 127.26.52.126:40605)
0807 22:38:39.793043 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:39.793047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:39.794157 (+ 1110us) server_negotiation.cc:407] Connection header received
0807 22:38:39.795532 (+ 1375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:39.795535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:39.795582 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:39.795657 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:39.796638 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.797283 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.798619 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.798924 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.799006 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:39.800017 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:39.800020 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:39.800022 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:39.800032 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:39.800046 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:39.800052 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:39.800104 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:39.800271 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 22:38:39.800316 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:38:39.801240 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:39.793360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40605 (local address 127.26.52.67:33137)
0807 22:38:39.794025 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:39.794062 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:39.795339 (+ 1277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:39.795810 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:39.795816 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:39.795892 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:39.796497 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:39.796513 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.797460 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.797463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:39.798502 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:39.798512 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:39.799042 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:39.799045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:39.799185 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:39.799798 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:39.799800 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:39.799836 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:39.799894 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:39.800104 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:39.800108 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:39.800111 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:38:39.800254 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 22:38:39.800468 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":108,"threads_started":1}
I20260807 22:38:39.802289 4854 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40605
I20260807 22:38:39.802515 4854 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:39.803001 4854 heartbeater.cc:511] Master 127.26.52.126:40605 requested a full tablet report, sending...
I20260807 22:38:39.803966 4383 ts_manager.cc:194] Registered new tserver with Master: 1f43450c4c7443cea036fb039bea3518 (127.26.52.67:39631)
I20260807 22:38:39.804631 4383 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.67:33137
I20260807 22:38:39.810369 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 22:38:39.813050 4424 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:39.812255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48824 (local address 127.26.52.126:40605)
0807 22:38:39.812363 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:39.812366 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:39.812583 (+ 217us) server_negotiation.cc:407] Connection header received
0807 22:38:39.812674 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:39.812676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:39.812710 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:39.812770 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:39.812967 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48824: BlockingRecv error: recv got EOF from 127.0.0.1:48824 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:38:39.813284 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 4446
I20260807 22:38:39.823228 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 4583
I20260807 22:38:39.830433 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 4721
I20260807 22:38:39.838541 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 4351
2026-08-07T22:38:39Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (881 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T22:38:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:39Z Disabled control of system clock
I20260807 22:38:39.869876 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:36677
--webserver_interface=127.26.52.126
--webserver_port=0
--builtin_ntp_servers=127.26.52.84:45317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:36677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 22:38:39.981238 4865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:39.981503 4865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:39.981537 4865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:39.985495 4865 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:39.985544 4865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:39.985559 4865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:39.985576 4865 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:39.985591 4865 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:39.990259 4865 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:36677
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:36677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:39.991181 4865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:39.992513 4865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:40.001039 4870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:40.001116 4871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:40.001070 4873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:40.001354 4865 server_base.cc:1034] running on GCE node
I20260807 22:38:40.002063 4865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:40.003125 4865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:40.004280 4865 hybrid_clock.cc:648] HybridClock initialized: now 1786142320004253 us; error 37 us; skew 500 ppm
I20260807 22:38:40.006057 4865 webserver.cc:460] Webserver started at http://127.26.52.126:43567/ using document root <none> and password file <none>
I20260807 22:38:40.006649 4865 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:40.006709 4865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:40.006963 4865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:40.009085 4865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "03295d18b0e347f8b7be9929bb52fc21"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "0e775a41a0950b0cfbb356f91ee51bab"
server_key_iv: "48ef3b3a5c6a695fbd11fef5cd5d499b"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.009662 4865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "03295d18b0e347f8b7be9929bb52fc21"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "0e775a41a0950b0cfbb356f91ee51bab"
server_key_iv: "48ef3b3a5c6a695fbd11fef5cd5d499b"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.013317 4865 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:38:40.015671 4879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:40.016901 4865 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:40.017035 4865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "03295d18b0e347f8b7be9929bb52fc21"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "0e775a41a0950b0cfbb356f91ee51bab"
server_key_iv: "48ef3b3a5c6a695fbd11fef5cd5d499b"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.017133 4865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:40.021930 4865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:40.022521 4865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:40.022699 4865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:40.029441 4865 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:36677
I20260807 22:38:40.029461 4933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:36677 every 8 connection(s)
I20260807 22:38:40.030330 4865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:40.033593 4934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:40.035316 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 4865
I20260807 22:38:40.035450 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:40.035733 26833 external_mini_cluster.cc:1428] Setting key 245d706b8abf2126d1997cd334cf3181
I20260807 22:38:40.040305 4934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21: Bootstrap starting.
I20260807 22:38:40.042112 4937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:40.037210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53960 (local address 127.26.52.126:36677)
0807 22:38:40.037853 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:40.037874 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:40.037919 (+ 45us) server_negotiation.cc:407] Connection header received
0807 22:38:40.038990 (+ 1071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:40.039013 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:40.039523 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:40.039915 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:40.040662 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:40.040667 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:40.040680 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:40.040691 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:40.040752 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:40.040775 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:40.040919 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:40.040985 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 22:38:40.041215 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":98,"threads_started":1}
I20260807 22:38:40.042977 4934 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:40.043710 4934 log.cc:824] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:40.045636 4934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21: No bootstrap required, opened a new log
I20260807 22:38:40.049268 4934 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03295d18b0e347f8b7be9929bb52fc21" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36677 } }
I20260807 22:38:40.049467 4934 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:40.049541 4934 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03295d18b0e347f8b7be9929bb52fc21, State: Initialized, Role: FOLLOWER
I20260807 22:38:40.049959 4934 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03295d18b0e347f8b7be9929bb52fc21" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36677 } }
I20260807 22:38:40.050107 4934 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:40.050170 4934 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:40.050284 4934 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:40.051138 4934 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03295d18b0e347f8b7be9929bb52fc21" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36677 } }
I20260807 22:38:40.051466 4934 leader_election.cc:302] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03295d18b0e347f8b7be9929bb52fc21; no voters:
I20260807 22:38:40.051757 4934 leader_election.cc:288] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:40.051882 4940 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:40.052148 4940 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [term 1 LEADER]: Becoming Leader. State: Replica: 03295d18b0e347f8b7be9929bb52fc21, State: Running, Role: LEADER
I20260807 22:38:40.052435 4940 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03295d18b0e347f8b7be9929bb52fc21" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36677 } }
I20260807 22:38:40.053117 4934 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:40.054225 4943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03295d18b0e347f8b7be9929bb52fc21. Latest consensus state: current_term: 1 leader_uuid: "03295d18b0e347f8b7be9929bb52fc21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03295d18b0e347f8b7be9929bb52fc21" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36677 } } }
I20260807 22:38:40.054248 4941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03295d18b0e347f8b7be9929bb52fc21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03295d18b0e347f8b7be9929bb52fc21" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36677 } } }
I20260807 22:38:40.054378 4943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:40.054380 4941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21 [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:40.054760 4950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:40.057682 4950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:40.062650 4950 catalog_manager.cc:1347] Generated new cluster ID: 2428553938624669b42533a8f4a29a50
I20260807 22:38:40.062714 4950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:40.088624 4950 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:40.088958 4950 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:40.093108 4950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03295d18b0e347f8b7be9929bb52fc21: Generated new TSK 0
I20260807 22:38:40.093729 4950 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:38:40.099958 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36677
--builtin_ntp_servers=127.26.52.84:45317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 22:38:40.211390 4960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:40.211648 4960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:40.211730 4960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:40.215886 4960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:40.215945 4960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:40.216059 4960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:40.220999 4960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:40.222170 4960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:40.223628 4960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:40.233088 4968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:40.233294 4966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:40.233289 4960 server_base.cc:1034] running on GCE node
W20260807 22:38:40.233093 4965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:40.233807 4960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:40.234407 4960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:40.235598 4960 hybrid_clock.cc:648] HybridClock initialized: now 1786142320235579 us; error 30 us; skew 500 ppm
I20260807 22:38:40.237501 4960 webserver.cc:460] Webserver started at http://127.26.52.65:39207/ using document root <none> and password file <none>
I20260807 22:38:40.238077 4960 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:40.238166 4960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:40.238402 4960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:40.240547 4960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "17d35a0f38f947e9975f3d6645b836a0"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "88bf25a69a7075c74cd848e82757584e"
server_key_iv: "e257f069534d444166ec45908e4929d4"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.241104 4960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "17d35a0f38f947e9975f3d6645b836a0"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "88bf25a69a7075c74cd848e82757584e"
server_key_iv: "e257f069534d444166ec45908e4929d4"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.244769 4960 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:38:40.247283 4974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:40.248544 4960 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260807 22:38:40.248679 4960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "17d35a0f38f947e9975f3d6645b836a0"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "88bf25a69a7075c74cd848e82757584e"
server_key_iv: "e257f069534d444166ec45908e4929d4"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.248785 4960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:40.253367 4960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:40.253994 4960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:40.254222 4960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:40.254794 4960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:40.255805 4960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:40.255852 4960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:40.255918 4960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:40.255970 4960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:40.265096 4960 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:37361
I20260807 22:38:40.265120 5091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:37361 every 8 connection(s)
I20260807 22:38:40.265969 4960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:40.267196 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 4960
I20260807 22:38:40.267341 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:38:40.267690 26833 external_mini_cluster.cc:1428] Setting key a2950f8cb05a5fed66f262c20d7d7264
I20260807 22:38:40.269894 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36677
--builtin_ntp_servers=127.26.52.84:45317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 22:38:40.272569 4937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:40.268180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:36541 (local address 127.26.52.126:36677)
0807 22:38:40.268345 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:40.268350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:40.269338 (+ 988us) server_negotiation.cc:407] Connection header received
0807 22:38:40.270734 (+ 1396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:40.270740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:40.270804 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:40.270905 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:40.272082 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:40.272085 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:40.272087 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:40.272099 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:40.272167 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:40.272179 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:40.272268 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:40.272425 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 22:38:40.272464 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:38:40.273567 5094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:40.268410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:36677 (local address 127.26.52.65:36541)
0807 22:38:40.269160 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:40.269220 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:40.270530 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:40.271050 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:40.271056 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:40.271136 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:40.271770 (+ 634us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:40.271774 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:40.271832 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:40.271921 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:40.272264 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:40.272275 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:40.272281 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:38:40.272471 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 22:38:40.272804 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":113,"threads_started":1}
I20260807 22:38:40.274771 5092 heartbeater.cc:347] Connected to a master server at 127.26.52.126:36677
I20260807 22:38:40.275012 5092 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:40.275420 5092 heartbeater.cc:511] Master 127.26.52.126:36677 requested a full tablet report, sending...
I20260807 22:38:40.276949 4897 ts_manager.cc:194] Registered new tserver with Master: 17d35a0f38f947e9975f3d6645b836a0 (127.26.52.65:37361)
W20260807 22:38:40.384172 5095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:40.384511 5095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:40.384606 5095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:40.388911 5095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:40.388998 5095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:40.389117 5095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:40.394115 5095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:40.395360 5095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:40.396919 5095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:40.406548 5102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:40.406582 5104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:40.406611 5101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:40.406898 5095 server_base.cc:1034] running on GCE node
I20260807 22:38:40.407334 5095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:40.407974 5095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:40.409160 5095 hybrid_clock.cc:648] HybridClock initialized: now 1786142320409132 us; error 48 us; skew 500 ppm
I20260807 22:38:40.411021 5095 webserver.cc:460] Webserver started at http://127.26.52.66:32911/ using document root <none> and password file <none>
I20260807 22:38:40.411609 5095 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:40.411703 5095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:40.411940 5095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:40.414031 5095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "905d828571974a13b70174016d781aea"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "c4e3dbaf49549760bdab8f9146d421de"
server_key_iv: "eae7c7050067e96235eaca45dd77b857"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.414597 5095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "905d828571974a13b70174016d781aea"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "c4e3dbaf49549760bdab8f9146d421de"
server_key_iv: "eae7c7050067e96235eaca45dd77b857"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.418184 5095 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 22:38:40.420666 5110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:40.421898 5095 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:40.422020 5095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "905d828571974a13b70174016d781aea"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "c4e3dbaf49549760bdab8f9146d421de"
server_key_iv: "eae7c7050067e96235eaca45dd77b857"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.422138 5095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:40.426605 5095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:40.427205 5095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:40.427390 5095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:40.427942 5095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:40.428905 5095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:40.429167 5095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:40.429343 5095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:40.429414 5095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:40.440366 5095 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:36567
I20260807 22:38:40.440387 5229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:36567 every 8 connection(s)
I20260807 22:38:40.441454 5095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:40.447278 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 5095
I20260807 22:38:40.447436 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:38:40.447772 26833 external_mini_cluster.cc:1428] Setting key eec9f185637ebd4a9781a5bb6cfe0bf4
I20260807 22:38:40.447814 4937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:40.443412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:40567 (local address 127.26.52.126:36677)
0807 22:38:40.443595 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:40.443602 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:40.444873 (+ 1271us) server_negotiation.cc:407] Connection header received
0807 22:38:40.446138 (+ 1265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:40.446141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:40.446179 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:40.446259 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:40.447279 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:40.447282 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:40.447285 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:40.447298 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:40.447320 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:40.447331 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:40.447434 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:40.447607 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 22:38:40.447664 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 22:38:40.448818 5232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:40.443948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:36677 (local address 127.26.52.66:40567)
0807 22:38:40.444716 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:40.444755 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:40.445924 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:40.446411 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:40.446417 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:40.446506 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:40.447027 (+ 521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:40.447029 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:40.447066 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:40.447128 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:40.447418 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:40.447436 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:40.447443 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:38:40.447625 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 22:38:40.447805 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":223,"threads_started":1}
I20260807 22:38:40.450001 5230 heartbeater.cc:347] Connected to a master server at 127.26.52.126:36677
I20260807 22:38:40.450143 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36677
--builtin_ntp_servers=127.26.52.84:45317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 22:38:40.450259 5230 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:40.450664 5230 heartbeater.cc:511] Master 127.26.52.126:36677 requested a full tablet report, sending...
I20260807 22:38:40.451759 4897 ts_manager.cc:194] Registered new tserver with Master: 905d828571974a13b70174016d781aea (127.26.52.66:36567)
W20260807 22:38:40.563131 5233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:40.563427 5233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:40.563513 5233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:40.567523 5233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:40.567601 5233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:40.567696 5233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:40.572468 5233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:36677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:40.573573 5233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:40.574978 5233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:40.584492 5242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:40.584569 5233 server_base.cc:1034] running on GCE node
W20260807 22:38:40.584523 5240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:40.584522 5239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:40.585098 5233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:40.585738 5233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:40.586922 5233 hybrid_clock.cc:648] HybridClock initialized: now 1786142320586887 us; error 51 us; skew 500 ppm
I20260807 22:38:40.588994 5233 webserver.cc:460] Webserver started at http://127.26.52.67:44723/ using document root <none> and password file <none>
I20260807 22:38:40.589592 5233 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:40.589690 5233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:40.589916 5233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:40.591964 5233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "9c21ddc65fcd42a3a2bd0eb4f2bd6de5"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "39f72bcf3b8e78572745e15892c60881"
server_key_iv: "d7c3bba3d82cc7c6b2807e1f1e27e92a"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.592622 5233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "9c21ddc65fcd42a3a2bd0eb4f2bd6de5"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "39f72bcf3b8e78572745e15892c60881"
server_key_iv: "d7c3bba3d82cc7c6b2807e1f1e27e92a"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.596295 5233 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:38:40.599069 5248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:40.600445 5233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:38:40.600585 5233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "9c21ddc65fcd42a3a2bd0eb4f2bd6de5"
format_stamp: "Formatted at 2026-08-07 22:38:40 on dist-test-slave-8w9v"
server_key: "39f72bcf3b8e78572745e15892c60881"
server_key_iv: "d7c3bba3d82cc7c6b2807e1f1e27e92a"
server_key_version: "encryptionkey@0"
I20260807 22:38:40.600704 5233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:40.605391 5233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:40.605999 5233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:40.606189 5233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:40.606794 5233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:40.607717 5233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:40.607765 5233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:40.607803 5233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:40.607827 5233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:40.616600 5233 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:34679
I20260807 22:38:40.616663 5368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:34679 every 8 connection(s)
I20260807 22:38:40.617599 5233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:38:40.623667 4937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:40.619440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:52221 (local address 127.26.52.126:36677)
0807 22:38:40.619621 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:40.619626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:40.620744 (+ 1118us) server_negotiation.cc:407] Connection header received
0807 22:38:40.622139 (+ 1395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:40.622142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:40.622179 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:40.622253 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:40.623328 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:40.623331 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:40.623333 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:38:40.623341 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:40.623356 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:38:40.623362 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:40.623428 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:40.623523 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 22:38:40.623559 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 22:38:40.624552 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:40.619827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:36677 (local address 127.26.52.67:52221)
0807 22:38:40.620560 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:40.620635 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:40.621932 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:40.622380 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:40.622386 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:40.622466 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:40.623087 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:38:40.623089 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:40.623127 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:38:40.623191 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:40.623414 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:40.623419 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:40.623422 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:38:40.623535 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:38:40.623732 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":120,"threads_started":1}
I20260807 22:38:40.625659 5370 heartbeater.cc:347] Connected to a master server at 127.26.52.126:36677
I20260807 22:38:40.625928 5370 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:40.626329 5370 heartbeater.cc:511] Master 127.26.52.126:36677 requested a full tablet report, sending...
I20260807 22:38:40.627348 4897 ts_manager.cc:194] Registered new tserver with Master: 9c21ddc65fcd42a3a2bd0eb4f2bd6de5 (127.26.52.67:34679)
I20260807 22:38:40.627367 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 5233
I20260807 22:38:40.627501 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:38:40.627825 26833 external_mini_cluster.cc:1428] Setting key 13dd01e511a4527d0d6fcb72b8ec22ab
I20260807 22:38:40.629933 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 22:38:40.632627 4937 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:38:40.631809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53962 (local address 127.26.52.126:36677)
0807 22:38:40.631928 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:40.631931 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:40.632102 (+ 171us) server_negotiation.cc:407] Connection header received
0807 22:38:40.632214 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:40.632216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:40.632244 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:40.632299 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:40.632505 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53962: BlockingRecv error: recv got EOF from 127.0.0.1:53962 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:38:40.633037 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 4960
I20260807 22:38:40.640503 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 5095
I20260807 22:38:40.647315 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 5233
I20260807 22:38:40.654454 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 4865
2026-08-07T22:38:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (815 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:38:40 dist-test-slave-8w9v krb5kdc[5380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:38:40 dist-test-slave-8w9v krb5kdc[5380](info): set up 2 sockets
Aug 07 22:38:40 dist-test-slave-8w9v krb5kdc[5380](info): commencing operation
krb5kdc: starting...
W20260807 22:38:41.837442 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:38:41 dist-test-slave-8w9v krb5kdc[5380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:38:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:38:41.975379 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40791
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:41399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:40791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:42.112298 5393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:42.112591 5393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:42.112630 5393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:42.116685 5393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:38:42.116755 5393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:42.116775 5393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:42.116791 5393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:38:42.116807 5393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:38:42.122197 5393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:41399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:40791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:42.123349 5393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:42.124428 5393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:42.133009 5401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:42.133016 5399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:42.133016 5398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:42.133213 5393 server_base.cc:1034] running on GCE node
I20260807 22:38:42.133991 5393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:42.135095 5393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:42.136266 5393 hybrid_clock.cc:648] HybridClock initialized: now 1786142322136240 us; error 33 us; skew 500 ppm
Aug 07 22:38:42 dist-test-slave-8w9v krb5kdc[5380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142322, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:42.139117 5393 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:38:42.140064 5393 webserver.cc:460] Webserver started at http://127.26.52.126:34253/ using document root <none> and password file <none>
I20260807 22:38:42.140672 5393 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:42.140736 5393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:42.140951 5393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:42.143165 5393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "cc2f5590e73a4dc6b30c413a253c86af"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "72c3af3467f58afc9b980ba805381a3c"
server_key_iv: "9a3ea21af411ff204f3d251dadd93723"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.143749 5393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "cc2f5590e73a4dc6b30c413a253c86af"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "72c3af3467f58afc9b980ba805381a3c"
server_key_iv: "9a3ea21af411ff204f3d251dadd93723"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.147603 5393 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 22:38:42.150065 5408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:42.151243 5393 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:42.151392 5393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "cc2f5590e73a4dc6b30c413a253c86af"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "72c3af3467f58afc9b980ba805381a3c"
server_key_iv: "9a3ea21af411ff204f3d251dadd93723"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.151505 5393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:42.181788 5393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:42.185472 5393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:42.185703 5393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:42.193717 5393 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:40791
I20260807 22:38:42.193742 5463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:40791 every 8 connection(s)
I20260807 22:38:42.194742 5393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:38:42.197669 5464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:42.203275 5464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af: Bootstrap starting.
I20260807 22:38:42.203850 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 5393
I20260807 22:38:42.204015 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:38:42.204329 26833 external_mini_cluster.cc:1428] Setting key 58e9851e4ddfa0d6b1b221822f123016
I20260807 22:38:42.206101 5464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:42.206826 5464 log.cc:824] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:42.209201 5464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af: No bootstrap required, opened a new log
Aug 07 22:38:42 dist-test-slave-8w9v krb5kdc[5380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:42.213917 5464 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2f5590e73a4dc6b30c413a253c86af" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40791 } }
I20260807 22:38:42.214159 5464 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:42.214214 5464 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2f5590e73a4dc6b30c413a253c86af, State: Initialized, Role: FOLLOWER
I20260807 22:38:42.214661 5464 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2f5590e73a4dc6b30c413a253c86af" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40791 } }
I20260807 22:38:42.214828 5464 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:38:42.214900 5464 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:38:42.215050 5464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:42.215976 5464 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2f5590e73a4dc6b30c413a253c86af" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40791 } }
I20260807 22:38:42.216342 5464 leader_election.cc:302] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc2f5590e73a4dc6b30c413a253c86af; no voters:
I20260807 22:38:42.216668 5464 leader_election.cc:288] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:38:42.216777 5469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:42.216964 5469 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [term 1 LEADER]: Becoming Leader. State: Replica: cc2f5590e73a4dc6b30c413a253c86af, State: Running, Role: LEADER
I20260807 22:38:42.217264 5469 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2f5590e73a4dc6b30c413a253c86af" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40791 } }
I20260807 22:38:42.217989 5464 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:38:42.219096 5470 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc2f5590e73a4dc6b30c413a253c86af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2f5590e73a4dc6b30c413a253c86af" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40791 } } }
I20260807 22:38:42.219139 5471 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc2f5590e73a4dc6b30c413a253c86af. Latest consensus state: current_term: 1 leader_uuid: "cc2f5590e73a4dc6b30c413a253c86af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2f5590e73a4dc6b30c413a253c86af" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40791 } } }
I20260807 22:38:42.219280 5471 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:42.219223 5470 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af [sys.catalog]: This master's current role is: LEADER
I20260807 22:38:42.219971 5467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.205626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35594 (local address 127.26.52.126:40791)
0807 22:38:42.206055 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:42.206070 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:42.206106 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:38:42.206759 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:42.206775 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:42.207138 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:42.207520 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:42.208389 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.209634 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.210793 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.211234 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.211351 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.214297 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:42.214305 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:42.214324 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:42.214362 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:42.216456 (+ 2094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:42.216947 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:42.216955 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:42.216962 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:42.217110 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:42.217435 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:42.217439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:42.217440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:42.217841 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:42.218055 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:42.218471 (+ 416us) server_negotiation.cc:299] Negotiation successful
0807 22:38:42.218815 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":137,"threads_started":1}
W20260807 22:38:42.223335 5485 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:38:42.223443 5485 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:38:42.223670 5479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:38:42.224670 5479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:38:42.230156 5479 catalog_manager.cc:1347] Generated new cluster ID: 9b639461993746f38a974366379b6131
I20260807 22:38:42.230221 5479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:38:42.251027 5479 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:38:42.252768 5479 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:38:42.259588 5479 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af: Generated new TSK 0
I20260807 22:38:42.260434 5479 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:38:42.296941 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40791
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:41399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:42.427721 5491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:42.428021 5491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:42.428071 5491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:42.432250 5491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:42.432331 5491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:42.432438 5491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:38:42.438476 5491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:41399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:42.439661 5491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:42.440810 5491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:42.451033 5496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:42.451033 5500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:42.451035 5497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:42.451150 5491 server_base.cc:1034] running on GCE node
I20260807 22:38:42.451812 5491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:42.452533 5491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:42.453694 5491 hybrid_clock.cc:648] HybridClock initialized: now 1786142322453663 us; error 43 us; skew 500 ppm
Aug 07 22:38:42 dist-test-slave-8w9v krb5kdc[5380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142322, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:42.456636 5491 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:38:42.457552 5491 webserver.cc:460] Webserver started at http://127.26.52.65:35419/ using document root <none> and password file <none>
I20260807 22:38:42.458145 5491 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:42.458209 5491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:42.458433 5491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:42.460580 5491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "4b5759eb6ccc07dac6d6b99bf1114c19"
server_key_iv: "4a335c247de08b95761ede6fc6feb69a"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.461165 5491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "4b5759eb6ccc07dac6d6b99bf1114c19"
server_key_iv: "4a335c247de08b95761ede6fc6feb69a"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.465242 5491 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:38:42.467787 5507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:42.469012 5491 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:38:42.469156 5491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "4b5759eb6ccc07dac6d6b99bf1114c19"
server_key_iv: "4a335c247de08b95761ede6fc6feb69a"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.469270 5491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:42.485918 5491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:42.488806 5491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:42.489033 5491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:42.489667 5491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:42.490543 5491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:42.490615 5491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:42.490689 5491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:42.490732 5491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:42.500331 5491 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:36075
I20260807 22:38:42.500360 5627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:36075 every 8 connection(s)
I20260807 22:38:42.501358 5491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:38:42.505971 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 5491
I20260807 22:38:42.506117 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:38:42.506412 26833 external_mini_cluster.cc:1428] Setting key 617d73c146e62df0ecfc93b1db3b6633
Aug 07 22:38:42 dist-test-slave-8w9v krb5kdc[5380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142322, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:42.516785 5467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.503281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:53757 (local address 127.26.52.126:40791)
0807 22:38:42.503468 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:42.503472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:42.504381 (+ 909us) server_negotiation.cc:407] Connection header received
0807 22:38:42.505880 (+ 1499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:42.505884 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:42.505952 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:42.506074 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:42.507418 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.507986 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.509272 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.509519 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.509645 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.512445 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:42.512453 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:42.512459 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:42.512498 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:42.514373 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:42.514907 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:42.514914 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:42.514919 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:42.515035 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:42.515392 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:42.515398 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:42.515400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:42.515679 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:42.515804 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:42.516397 (+ 593us) server_negotiation.cc:299] Negotiation successful
0807 22:38:42.516547 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:38:42.517427 5630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.503548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40791 (local address 127.26.52.65:53757)
0807 22:38:42.504105 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:42.504260 (+ 155us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:42.505639 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:42.506275 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:42.506282 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:42.506734 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:42.507245 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.507261 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.508180 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.508187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.509098 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.509110 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.509691 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.509695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.509885 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.510554 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:42.510572 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:42.512258 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:42.514504 (+ 2246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:42.514508 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:42.514521 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:42.514778 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:42.515147 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:42.515150 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:42.515151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:42.515276 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:42.515807 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:42.515812 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:42.516065 (+ 253us) client_negotiation.cc:769] Sending connection context
0807 22:38:42.516275 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 22:38:42.516543 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:38:42.518894 5628 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40791
I20260807 22:38:42.519172 5628 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:42.519824 5628 heartbeater.cc:511] Master 127.26.52.126:40791 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:38:42.521564 5425 ts_manager.cc:194] Registered new tserver with Master: bb1a10f1e5034f0e99f75fb8318ae8a6 (127.26.52.65:36075)
I20260807 22:38:42.522755 5425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:53757
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:38:42.536684 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40791
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:41399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:42.649528 5635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:42.649768 5635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:42.649809 5635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:42.653788 5635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:42.653836 5635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:42.653929 5635 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:38:42.659210 5635 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:41399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:42.660307 5635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:42.661319 5635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:42.670950 5643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:42.671095 5640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:42.670951 5641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:42.671051 5635 server_base.cc:1034] running on GCE node
I20260807 22:38:42.671590 5635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:42.672325 5635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:42.673507 5635 hybrid_clock.cc:648] HybridClock initialized: now 1786142322673496 us; error 24 us; skew 500 ppm
Aug 07 22:38:42 dist-test-slave-8w9v krb5kdc[5380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142322, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:42.676290 5635 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:38:42.677136 5635 webserver.cc:460] Webserver started at http://127.26.52.66:40391/ using document root <none> and password file <none>
I20260807 22:38:42.677753 5635 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:42.677845 5635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:42.678061 5635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:42.680073 5635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "a9301901de624de7bf790848a0f1d95d"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "273a386ce9f5360f7ece7fb735938815"
server_key_iv: "83f2a4a4374521e7f1087314aede89ee"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.680694 5635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "a9301901de624de7bf790848a0f1d95d"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "273a386ce9f5360f7ece7fb735938815"
server_key_iv: "83f2a4a4374521e7f1087314aede89ee"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.684360 5635 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:38:42.686790 5650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:42.687999 5635 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:42.688210 5635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "a9301901de624de7bf790848a0f1d95d"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "273a386ce9f5360f7ece7fb735938815"
server_key_iv: "83f2a4a4374521e7f1087314aede89ee"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.688328 5635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:42.706681 5635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:42.710042 5635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:42.710246 5635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:42.710839 5635 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:42.711669 5635 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:42.711740 5635 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:42.711813 5635 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:42.711865 5635 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:42.721083 5635 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:43943
I20260807 22:38:42.721105 5772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:43943 every 8 connection(s)
I20260807 22:38:42.721949 5635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:38:42.722998 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 5635
I20260807 22:38:42.723127 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:38:42.723413 26833 external_mini_cluster.cc:1428] Setting key 0d101246c3df1c2554e4559d1fb9a23f
Aug 07 22:38:42 dist-test-slave-8w9v krb5kdc[5380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142322, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:38:42.736685 5467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.723826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:49503 (local address 127.26.52.126:40791)
0807 22:38:42.723970 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:42.723974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:42.724989 (+ 1015us) server_negotiation.cc:407] Connection header received
0807 22:38:42.726376 (+ 1387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:42.726380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:42.726446 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:42.726518 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:42.727607 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.728200 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.729946 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.730183 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.730299 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.732775 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:42.732781 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:42.732789 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:42.732814 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:42.734405 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:42.734914 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:42.734917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:42.734920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:42.735005 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:42.735475 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:42.735477 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:42.735478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:42.735664 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:42.735775 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:42.736362 (+ 587us) server_negotiation.cc:299] Negotiation successful
0807 22:38:42.736502 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
I20260807 22:38:42.737617 5775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.724295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40791 (local address 127.26.52.66:49503)
0807 22:38:42.724816 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:42.724871 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:42.726167 (+ 1296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:42.726678 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:42.726685 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:42.727020 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:42.727466 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.727478 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.728333 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.728339 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.729782 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.729798 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.730339 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.730343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.730518 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.731129 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:42.731144 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:42.732614 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:42.734529 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:42.734536 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:42.734550 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:42.734807 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:42.735098 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:42.735102 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:42.735104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:42.735250 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:42.735774 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:42.735781 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:42.736048 (+ 267us) client_negotiation.cc:769] Sending connection context
0807 22:38:42.736315 (+ 267us) client_negotiation.cc:240] Negotiation successful
0807 22:38:42.736640 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":114,"threads_started":1}
I20260807 22:38:42.738827 5773 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40791
I20260807 22:38:42.739092 5773 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:42.739676 5773 heartbeater.cc:511] Master 127.26.52.126:40791 requested a full tablet report, sending...
I20260807 22:38:42.740856 5425 ts_manager.cc:194] Registered new tserver with Master: a9301901de624de7bf790848a0f1d95d (127.26.52.66:43943)
I20260807 22:38:42.741430 5425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:49503
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:38:42.755254 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40791
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:41399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:38:42.868446 5778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:38:42.868716 5778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:38:42.868791 5778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:38:42.872805 5778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:38:42.872876 5778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:38:42.872960 5778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:38:42.878098 5778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:41399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:38:42.879122 5778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:38:42.880195 5778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:38:42.889549 5783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:42.889549 5786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:38:42.889580 5784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:38:42.889850 5778 server_base.cc:1034] running on GCE node
I20260807 22:38:42.890302 5778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:38:42.890947 5778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:38:42.892163 5778 hybrid_clock.cc:648] HybridClock initialized: now 1786142322892133 us; error 42 us; skew 500 ppm
Aug 07 22:38:42 dist-test-slave-8w9v krb5kdc[5380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142322, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:38:42.894958 5778 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:38:42.895792 5778 webserver.cc:460] Webserver started at http://127.26.52.67:46143/ using document root <none> and password file <none>
I20260807 22:38:42.896445 5778 fs_manager.cc:359] Metadata directory not provided
I20260807 22:38:42.896535 5778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:38:42.896770 5778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:38:42.899052 5778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "4c43a334348d416f87f135d755d14231"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "cfc8cce55808c972bbbc894e9be327e1"
server_key_iv: "d93ea65f29f142bd881f85917e8da611"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.899693 5778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "4c43a334348d416f87f135d755d14231"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "cfc8cce55808c972bbbc894e9be327e1"
server_key_iv: "d93ea65f29f142bd881f85917e8da611"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.903798 5778 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260807 22:38:42.906361 5794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:42.907593 5778 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:38:42.907735 5778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "4c43a334348d416f87f135d755d14231"
format_stamp: "Formatted at 2026-08-07 22:38:42 on dist-test-slave-8w9v"
server_key: "cfc8cce55808c972bbbc894e9be327e1"
server_key_iv: "d93ea65f29f142bd881f85917e8da611"
server_key_version: "encryptionkey@0"
I20260807 22:38:42.907852 5778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:38:42.918927 5778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:38:42.922220 5778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:38:42.922377 5778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:38:42.922894 5778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:38:42.923689 5778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:38:42.923736 5778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:42.923776 5778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:38:42.923799 5778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:38:42.931838 5778 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:33707
I20260807 22:38:42.931936 5912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:33707 every 8 connection(s)
I20260807 22:38:42.932798 5778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:38:42 dist-test-slave-8w9v krb5kdc[5380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142322, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:38:42.942489 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 5778
I20260807 22:38:42.942641 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:38:42.942948 26833 external_mini_cluster.cc:1428] Setting key e5e2e6cf7222e3589196a364b1c90dcb
I20260807 22:38:42.946405 5467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.934564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:43235 (local address 127.26.52.126:40791)
0807 22:38:42.934709 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:42.934713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:42.935499 (+ 786us) server_negotiation.cc:407] Connection header received
0807 22:38:42.936986 (+ 1487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:42.936991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:42.937051 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:42.937155 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:42.938258 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.938888 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.940014 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.940286 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.940398 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.942685 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:42.942689 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:42.942690 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:42.942734 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:42.944431 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:42.944931 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:42.944935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:42.944937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:42.945024 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:42.945354 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:42.945358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:42.945360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:42.945542 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:42.945649 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:42.946120 (+ 471us) server_negotiation.cc:299] Negotiation successful
0807 22:38:42.946239 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:38:42.947139 5915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.934912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40791 (local address 127.26.52.67:43235)
0807 22:38:42.935337 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:42.935378 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:42.936767 (+ 1389us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:42.937320 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:42.937326 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:42.937665 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:38:42.938110 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.938123 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.939026 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.939030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.939881 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.939891 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.940446 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.940450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.940614 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.941110 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:38:42.941125 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:38:42.942511 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:38:42.944550 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:42.944556 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:42.944569 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:42.944822 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:42.945117 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:38:42.945122 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:38:42.945124 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:38:42.945258 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:38:42.945649 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:38:42.945657 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:38:42.945888 (+ 231us) client_negotiation.cc:769] Sending connection context
0807 22:38:42.946077 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 22:38:42.946375 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":109,"threads_started":1}
I20260807 22:38:42.948267 5913 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40791
I20260807 22:38:42.948467 5913 heartbeater.cc:464] Registering TS with master...
I20260807 22:38:42.948881 5913 heartbeater.cc:511] Master 127.26.52.126:40791 requested a full tablet report, sending...
I20260807 22:38:42.949810 5425 ts_manager.cc:194] Registered new tserver with Master: 4c43a334348d416f87f135d755d14231 (127.26.52.67:33707)
I20260807 22:38:42.950325 5425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:43235
I20260807 22:38:42.957050 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:38:42.966681 5467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.959069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35602 (local address 127.26.52.126:40791)
0807 22:38:42.959232 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:42.959236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:42.959454 (+ 218us) server_negotiation.cc:407] Connection header received
0807 22:38:42.959624 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:42.959627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:42.959681 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:42.959766 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:38:42.960571 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.961099 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.961982 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.962205 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.962311 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.963645 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:38:42.963648 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:38:42.963651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:38:42.963678 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:38:42.964935 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:42.965388 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:42.965393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:42.965395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:42.965487 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:38:42.965759 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:38:42.965763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:38:42.965764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:38:42.965997 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:38:42.966140 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:42.966376 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 22:38:42.966506 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:38:42.969691 5425 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:38:42.972994 5425 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:38:42.987988 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.983071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47690 (local address 127.26.52.67:33707)
0807 22:38:42.983500 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:42.983511 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:42.983531 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:38:42.983613 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:42.983618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:42.983784 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:42.983931 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:42.984210 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.985299 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.986684 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.987296 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.987432 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.987595 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:42.987719 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 22:38:42.987814 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":140,"threads_started":1}
I20260807 22:38:42.987984 5928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.981885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:33707 (local address 127.0.0.1:47690)
0807 22:38:42.982738 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:42.982755 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:42.982899 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:42.983975 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:42.983978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:42.983997 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:42.984073 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.984078 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.985448 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.985452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.986546 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.986560 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.987435 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.987439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.987541 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.987576 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 22:38:42.987689 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:38:42.987814 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":786,"spinlock_wait_cycles":9984,"thread_start_us":123,"threads_started":1}
I20260807 22:38:42.988224 5927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.982160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:43943 (local address 127.0.0.1:54898)
0807 22:38:42.982884 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:42.982896 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:42.982976 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:42.983713 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:42.983716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:42.983728 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:42.983803 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.983807 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.985317 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.985320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.986469 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.986478 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.987783 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.987788 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.987881 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.987917 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 22:38:42.987994 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:38:42.988067 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":101,"threads_started":1}
I20260807 22:38:42.988341 5926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.981933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35330 (local address 127.26.52.65:36075)
0807 22:38:42.982326 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:42.982345 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:42.982766 (+ 421us) server_negotiation.cc:407] Connection header received
0807 22:38:42.983120 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:42.983127 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:42.983345 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:42.983499 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:42.983955 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.984822 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.986779 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.987568 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.987663 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.987780 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:42.988057 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 22:38:42.988179 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":75,"threads_started":1}
I20260807 22:38:42.988706 5929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.982646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54898 (local address 127.26.52.66:43943)
0807 22:38:42.983267 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:42.983280 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:42.983302 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:38:42.983379 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:42.983384 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:42.983595 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:42.983740 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:42.983908 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.985178 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.986597 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.987454 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.987565 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.987717 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:42.988426 (+ 709us) server_negotiation.cc:299] Negotiation successful
0807 22:38:42.988541 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":129,"threads_started":1}
I20260807 22:38:42.988781 5925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:42.981813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:36075 (local address 127.0.0.1:35330)
0807 22:38:42.982607 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:42.982659 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:42.982899 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:42.983630 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:42.983638 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:42.983663 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:42.983799 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.983805 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.984972 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.984978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.986664 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:42.986673 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:42.987830 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:42.987833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:42.987903 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:42.987920 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 22:38:42.988572 (+ 652us) client_negotiation.cc:240] Negotiation successful
0807 22:38:42.988648 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":58,"spinlock_wait_cycles":2944,"thread_start_us":104,"threads_started":1}
I20260807 22:38:42.991586 5559 tablet_service.cc:1467] Processing CreateTablet for tablet 039226a077c9453aae6657766f8023d3 (DEFAULT_TABLE table=test-table [id=c7a83080784d4ff1a4b15c1181936240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:42.991570 5845 tablet_service.cc:1467] Processing CreateTablet for tablet 039226a077c9453aae6657766f8023d3 (DEFAULT_TABLE table=test-table [id=c7a83080784d4ff1a4b15c1181936240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:42.991570 5701 tablet_service.cc:1467] Processing CreateTablet for tablet 039226a077c9453aae6657766f8023d3 (DEFAULT_TABLE table=test-table [id=c7a83080784d4ff1a4b15c1181936240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:38:42.992719 5559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 039226a077c9453aae6657766f8023d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:42.992727 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 039226a077c9453aae6657766f8023d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:42.992816 5701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 039226a077c9453aae6657766f8023d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:38:42.999305 5931 tablet_bootstrap.cc:492] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6: Bootstrap starting.
I20260807 22:38:43.000964 5932 tablet_bootstrap.cc:492] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: Bootstrap starting.
I20260807 22:38:43.002022 5931 tablet_bootstrap.cc:654] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:43.003430 5931 log.cc:824] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:43.003773 5932 tablet_bootstrap.cc:654] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:43.004458 5934 tablet_bootstrap.cc:492] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: Bootstrap starting.
I20260807 22:38:43.004714 5932 log.cc:824] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:43.007184 5931 tablet_bootstrap.cc:492] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6: No bootstrap required, opened a new log
I20260807 22:38:43.007181 5934 tablet_bootstrap.cc:654] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: Neither blocks nor log segments found. Creating new log.
I20260807 22:38:43.007432 5931 ts_tablet_manager.cc:1397] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 22:38:43.008057 5934 log.cc:824] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: Log is configured to *not* fsync() on all Append() calls
I20260807 22:38:43.009536 5932 tablet_bootstrap.cc:492] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: No bootstrap required, opened a new log
I20260807 22:38:43.009770 5932 ts_tablet_manager.cc:1397] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260807 22:38:43.010187 5934 tablet_bootstrap.cc:492] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: No bootstrap required, opened a new log
I20260807 22:38:43.010387 5934 ts_tablet_manager.cc:1397] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:38:43.011631 5931 raft_consensus.cc:348] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 } } peers { permanent_uuid: "4c43a334348d416f87f135d755d14231" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33707 } } peers { permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 } }
I20260807 22:38:43.011955 5931 raft_consensus.cc:374] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:43.012017 5931 raft_consensus.cc:729] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb1a10f1e5034f0e99f75fb8318ae8a6, State: Initialized, Role: FOLLOWER
I20260807 22:38:43.012574 5931 consensus_queue.cc:260] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 } } peers { permanent_uuid: "4c43a334348d416f87f135d755d14231" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33707 } } peers { permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 } }
I20260807 22:38:43.013764 5931 ts_tablet_manager.cc:1428] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:38:43.013429 5932 raft_consensus.cc:348] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 } } peers { permanent_uuid: "4c43a334348d416f87f135d755d14231" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33707 } } peers { permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 } }
I20260807 22:38:43.014216 5932 raft_consensus.cc:374] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:43.014285 5932 raft_consensus.cc:729] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c43a334348d416f87f135d755d14231, State: Initialized, Role: FOLLOWER
I20260807 22:38:43.013389 5628 heartbeater.cc:503] Master 127.26.52.126:40791 was elected leader, sending a full tablet report...
I20260807 22:38:43.014799 5934 raft_consensus.cc:348] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 } } peers { permanent_uuid: "4c43a334348d416f87f135d755d14231" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33707 } } peers { permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 } }
I20260807 22:38:43.015051 5934 raft_consensus.cc:374] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:38:43.015100 5934 raft_consensus.cc:729] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9301901de624de7bf790848a0f1d95d, State: Initialized, Role: FOLLOWER
I20260807 22:38:43.015096 5932 consensus_queue.cc:260] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 } } peers { permanent_uuid: "4c43a334348d416f87f135d755d14231" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33707 } } peers { permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 } }
I20260807 22:38:43.015502 5934 consensus_queue.cc:260] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 } } peers { permanent_uuid: "4c43a334348d416f87f135d755d14231" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33707 } } peers { permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 } }
I20260807 22:38:43.016101 5913 heartbeater.cc:503] Master 127.26.52.126:40791 was elected leader, sending a full tablet report...
I20260807 22:38:43.016238 5932 ts_tablet_manager.cc:1428] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:38:43.016515 5934 ts_tablet_manager.cc:1428] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:38:43.016861 5773 heartbeater.cc:503] Master 127.26.52.126:40791 was elected leader, sending a full tablet report...
I20260807 22:38:43.119575 5939 raft_consensus.cc:482] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:38:43.119820 5939 raft_consensus.cc:504] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 } } peers { permanent_uuid: "4c43a334348d416f87f135d755d14231" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33707 } } peers { permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 } }
I20260807 22:38:43.121172 5939 leader_election.cc:288] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb1a10f1e5034f0e99f75fb8318ae8a6 (127.26.52.65:36075), a9301901de624de7bf790848a0f1d95d (127.26.52.66:43943)
I20260807 22:38:43.126310 5926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:43.121545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:59899 (local address 127.26.52.65:36075)
0807 22:38:43.121708 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:43.121716 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:43.121747 (+ 31us) server_negotiation.cc:407] Connection header received
0807 22:38:43.121813 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:43.121817 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:43.121884 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:43.121971 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:43.122327 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:43.123217 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:43.124840 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:43.125503 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:43.125643 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:43.125699 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:43.126085 (+ 386us) server_negotiation.cc:299] Negotiation successful
0807 22:38:43.126160 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:38:43.126312 5915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:43.121410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:36075 (local address 127.26.52.67:59899)
0807 22:38:43.121532 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:43.121551 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:43.121656 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:43.121998 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:43.122003 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:43.122044 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:43.122188 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:43.122194 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:43.123331 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:43.123333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:43.124691 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:43.124703 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:43.125645 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:43.125649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:43.125898 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:43.125969 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 22:38:43.126042 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 22:38:43.126135 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":167,"spinlock_wait_cycles":27008}
I20260807 22:38:43.126328 5929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:43.121746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:60561 (local address 127.26.52.66:43943)
0807 22:38:43.121871 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:43.121876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:43.122045 (+ 169us) server_negotiation.cc:407] Connection header received
0807 22:38:43.122144 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:43.122147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:43.122192 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:43.122289 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:38:43.122540 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:43.123338 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:43.124840 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:43.125522 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:43.125643 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:43.125699 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:43.126085 (+ 386us) server_negotiation.cc:299] Negotiation successful
0807 22:38:43.126160 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:38:43.126322 5941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:43.121542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:43943 (local address 127.26.52.67:60561)
0807 22:38:43.121928 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:43.121941 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:38:43.122050 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:38:43.122303 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:38:43.122307 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:38:43.122325 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:38:43.122427 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:43.122432 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:43.123464 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:43.123467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:43.124694 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:38:43.124703 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:38:43.125645 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:38:43.125649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:38:43.125916 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:43.125963 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 22:38:43.126042 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 22:38:43.126135 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":150,"spinlock_wait_cycles":4224,"thread_start_us":166,"threads_started":1}
I20260807 22:38:43.127086 5580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "039226a077c9453aae6657766f8023d3" candidate_uuid: "4c43a334348d416f87f135d755d14231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" is_pre_election: true
I20260807 22:38:43.127089 5724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "039226a077c9453aae6657766f8023d3" candidate_uuid: "4c43a334348d416f87f135d755d14231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9301901de624de7bf790848a0f1d95d" is_pre_election: true
I20260807 22:38:43.127378 5580 raft_consensus.cc:2454] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c43a334348d416f87f135d755d14231 in term 0.
I20260807 22:38:43.127413 5724 raft_consensus.cc:2454] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c43a334348d416f87f135d755d14231 in term 0.
I20260807 22:38:43.127916 5798 leader_election.cc:302] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4c43a334348d416f87f135d755d14231, a9301901de624de7bf790848a0f1d95d, bb1a10f1e5034f0e99f75fb8318ae8a6; no voters:
I20260807 22:38:43.128238 5939 raft_consensus.cc:2781] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:38:43.128322 5939 raft_consensus.cc:482] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:38:43.128365 5939 raft_consensus.cc:3037] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:43.129354 5939 raft_consensus.cc:504] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 } } peers { permanent_uuid: "4c43a334348d416f87f135d755d14231" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33707 } } peers { permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 } }
I20260807 22:38:43.129722 5939 leader_election.cc:288] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [CANDIDATE]: Term 1 election: Requested vote from peers bb1a10f1e5034f0e99f75fb8318ae8a6 (127.26.52.65:36075), a9301901de624de7bf790848a0f1d95d (127.26.52.66:43943)
I20260807 22:38:43.130088 5580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "039226a077c9453aae6657766f8023d3" candidate_uuid: "4c43a334348d416f87f135d755d14231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6"
I20260807 22:38:43.130146 5724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "039226a077c9453aae6657766f8023d3" candidate_uuid: "4c43a334348d416f87f135d755d14231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9301901de624de7bf790848a0f1d95d"
I20260807 22:38:43.130201 5580 raft_consensus.cc:3037] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:43.130306 5724 raft_consensus.cc:3037] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:38:43.131278 5580 raft_consensus.cc:2454] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c43a334348d416f87f135d755d14231 in term 1.
I20260807 22:38:43.131559 5724 raft_consensus.cc:2454] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c43a334348d416f87f135d755d14231 in term 1.
I20260807 22:38:43.131556 5798 leader_election.cc:302] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c43a334348d416f87f135d755d14231, bb1a10f1e5034f0e99f75fb8318ae8a6; no voters:
I20260807 22:38:43.131732 5939 raft_consensus.cc:2781] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:38:43.131982 5939 raft_consensus.cc:686] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 1 LEADER]: Becoming Leader. State: Replica: 4c43a334348d416f87f135d755d14231, State: Running, Role: LEADER
I20260807 22:38:43.132341 5939 consensus_queue.cc:237] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 } } peers { permanent_uuid: "4c43a334348d416f87f135d755d14231" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33707 } } peers { permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 } }
I20260807 22:38:43.135802 5425 catalog_manager.cc:5495] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c43a334348d416f87f135d755d14231 (127.26.52.67). New cstate: current_term: 1 leader_uuid: "4c43a334348d416f87f135d755d14231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c43a334348d416f87f135d755d14231" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 } health_report { overall_health: UNKNOWN } } }
I20260807 22:38:43.181286 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:43.178060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47692 (local address 127.26.52.67:33707)
0807 22:38:43.178191 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 22:38:43.178194 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:38:43.178228 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:38:43.178303 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:38:43.178305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:38:43.178363 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:38:43.178445 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:38:43.178662 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:43.179156 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:43.179971 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:38:43.180234 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:38:43.180315 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:38:43.180580 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:38:43.180983 (+ 403us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:38:43.181069 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:38:43.181129 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 22:38:43.181177 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 22:38:43.183674 5914 tablet.cc:2369] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:38:43.187026 5724 raft_consensus.cc:1261] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d [term 1 FOLLOWER]: Refusing update from remote peer 4c43a334348d416f87f135d755d14231: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:43.187027 5580 raft_consensus.cc:1261] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6 [term 1 FOLLOWER]: Refusing update from remote peer 4c43a334348d416f87f135d755d14231: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:38:43.187714 5942 consensus_queue.cc:1035] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb1a10f1e5034f0e99f75fb8318ae8a6" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:43.187943 5939 consensus_queue.cc:1035] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9301901de624de7bf790848a0f1d95d" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 43943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:38:43.195068 5945 mvcc.cc:205] Tried to move back new op lower bound from 7316038955767078912 to 7316038955552628736. Current Snapshot: MvccSnapshot[applied={T|T < 7316038955767078912}]
I20260807 22:38:43.196815 5946 mvcc.cc:205] Tried to move back new op lower bound from 7316038955767078912 to 7316038955552628736. Current Snapshot: MvccSnapshot[applied={T|T < 7316038955767078912}]
I20260807 22:38:43.200970 5947 mvcc.cc:205] Tried to move back new op lower bound from 7316038955767078912 to 7316038955552628736. Current Snapshot: MvccSnapshot[applied={T|T < 7316038955767078912 or (T in {7316038955767078912})}]
I20260807 22:38:43.205065 5425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:43.205240 5425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:38:43.207510 5425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cc2f5590e73a4dc6b30c413a253c86af: Sending DeleteTablet for 3 replicas of tablet 039226a077c9453aae6657766f8023d3
I20260807 22:38:43.208252 5845 tablet_service.cc:1514] Processing DeleteTablet for tablet 039226a077c9453aae6657766f8023d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:43 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:47690
I20260807 22:38:43.208251 5559 tablet_service.cc:1514] Processing DeleteTablet for tablet 039226a077c9453aae6657766f8023d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:43 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:35330
I20260807 22:38:43.208750 5956 tablet_replica.cc:330] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6: stopping tablet replica
I20260807 22:38:43.208971 5955 tablet_replica.cc:330] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: stopping tablet replica
I20260807 22:38:43.209151 5701 tablet_service.cc:1514] Processing DeleteTablet for tablet 039226a077c9453aae6657766f8023d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:38:43 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:54898
I20260807 22:38:43.209563 5956 raft_consensus.cc:2229] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:43.209753 5955 raft_consensus.cc:2229] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:38:43.210139 5955 raft_consensus.cc:2258] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:43.210532 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 5491
I20260807 22:38:43.210644 5956 raft_consensus.cc:2258] T 039226a077c9453aae6657766f8023d3 P bb1a10f1e5034f0e99f75fb8318ae8a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:43.212095 5957 tablet_replica.cc:330] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: stopping tablet replica
I20260807 22:38:43.212450 5957 raft_consensus.cc:2229] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:38:43.212755 5957 raft_consensus.cc:2258] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:38:43.212873 5955 ts_tablet_manager.cc:1905] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:43.214259 5957 ts_tablet_manager.cc:1905] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:38:43.216374 5955 ts_tablet_manager.cc:1918] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:43.216601 5955 log.cc:1196] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/039226a077c9453aae6657766f8023d3
I20260807 22:38:43.216928 5957 ts_tablet_manager.cc:1918] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:38:43.217027 5957 log.cc:1196] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/039226a077c9453aae6657766f8023d3
I20260807 22:38:43.217146 5955 ts_tablet_manager.cc:1939] T 039226a077c9453aae6657766f8023d3 P 4c43a334348d416f87f135d755d14231: Deleting consensus metadata
I20260807 22:38:43.217336 5957 ts_tablet_manager.cc:1939] T 039226a077c9453aae6657766f8023d3 P a9301901de624de7bf790848a0f1d95d: Deleting consensus metadata
I20260807 22:38:43.218570 5409 catalog_manager.cc:4841] TS a9301901de624de7bf790848a0f1d95d (127.26.52.66:43943): tablet 039226a077c9453aae6657766f8023d3 (table test-table [id=c7a83080784d4ff1a4b15c1181936240]) successfully deleted
I20260807 22:38:43.218583 5411 catalog_manager.cc:4841] TS 4c43a334348d416f87f135d755d14231 (127.26.52.67:33707): tablet 039226a077c9453aae6657766f8023d3 (table test-table [id=c7a83080784d4ff1a4b15c1181936240]) successfully deleted
W20260807 22:38:43.223012 5412 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:36075 (error 108)
I20260807 22:38:43.223806 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 5635
I20260807 22:38:43.224092 5925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:38:43.223758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:36075 (local address 127.0.0.1:35342)
0807 22:38:43.223907 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 22:38:43.223988 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:36075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 22:38:43.224681 5412 catalog_manager.cc:4584] TS bb1a10f1e5034f0e99f75fb8318ae8a6 (127.26.52.65:36075): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 039226a077c9453aae6657766f8023d3: Network error: Client connection negotiation failed: client connection to 127.26.52.65:36075: connect: Connection refused (error 111)
I20260807 22:38:43.231983 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 5778
I20260807 22:38:43.239588 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 5393
2026-08-07T22:38:43Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2586 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:38:43 dist-test-slave-8w9v krb5kdc[5961](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:38:43 dist-test-slave-8w9v krb5kdc[5961](info): set up 2 sockets
Aug 07 22:38:43 dist-test-slave-8w9v krb5kdc[5961](info): commencing operation
krb5kdc: starting...
W20260807 22:38:44.315003 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:38:44 dist-test-slave-8w9v krb5kdc[5961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:38:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:38:44Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.52.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.52.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/rangeradmin_127.26.52.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/rangeradmin_127.26.52.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.52.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.52.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/rangerlookup_127.26.52.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/rangerlookup_127.26.52.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.52.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.52.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/HTTP_127.26.52.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/HTTP_127.26.52.84@KRBTEST.COM.keytab.
I20260807 22:38:44.492662 26833 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskDuvoCt/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/postgres -l logfile start
2026-08-07 22:38:46.932 UTC [5991] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 22:38:46.933 UTC [5991] LOG: listening on IPv4 address "127.26.52.84", port 54741
2026-08-07 22:38:46.936 UTC [5991] LOG: listening on Unix socket "/tmp/.s.PGSQL.54741"
2026-08-07 22:38:46.958 UTC [5995] LOG: database system was shut down at 2026-08-07 22:38:45 UTC
2026-08-07 22:38:46.962 UTC [5991] LOG: database system is ready to accept connections
I20260807 22:38:47.948091 26833 mini_postgres.cc:96] Postgres bound to 54741
2026-08-07 22:38:47.956 UTC [6003] FATAL: database "slave" does not exist
127.26.52.84:54741 - accepting connections
I20260807 22:38:47.957027 26833 mini_ranger.cc:161] Starting Ranger...
I20260807 22:38:47.972568 26833 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 22:38:48.404405 26833 mini_ranger.cc:87] Created ranger Postgres database
I20260807 22:38:48.404497 26833 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-admin
2026-08-07 22:38:48,725 [I] DB FLAVOR :POSTGRES
2026-08-07 22:38:48,725 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:38:48,725 [I] Checking connection..
2026-08-07 22:38:48,726 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 22:38:48,995 [I] Checking connection passed.
2026-08-07 22:38:48,995 [I] --------- Verifying version history table ---------
2026-08-07 22:38:48,995 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:38:49,255 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:38:49,256 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:38:49,514 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:38:49,515 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 22:38:49,515 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 22:38:49.757 UTC [6076] WARNING: there is no transaction in progress
2026-08-07 22:38:49,763 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 22:38:49,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:38:50,013 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 22:38:50,014 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:38:50,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 22:38:50,254 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 22:38:50,509 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8w9v.c.gcp-upstream.internal','N') ;"
2026-08-07 22:38:50,778 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:38:51,079 [I] Table x_portal_user does not exist in database ranger
2026-08-07 22:38:51,079 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:38:51,357 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 22:38:51,357 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:38:51,629 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:38:51,890 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 22:38:51,890 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 22:38:52.862 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:52.878 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:52.895 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:52.910 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:52.926 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:52.944 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53.009 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53.016 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53.029 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53.039 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53.049 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53.063 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53.073 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53.080 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53.086 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53.093 UTC [6195] WARNING: there is no transaction in progress
2026-08-07 22:38:53,708 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 22:38:53,709 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 22:38:53,972 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 22:38:53,973 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:38:54,228 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 22:38:54,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:38:54,498 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 22:38:54,499 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:38:54,745 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:38:54,994 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8w9v.c.gcp-upstream.internal';"
2026-08-07 22:38:55,221 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 22:38:55,222 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 22:38:55,479 [I] DB_PATCHES have already been applied
I20260807 22:38:55.485350 26833 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-admin:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskDuvoCt/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 22:38:55.485440 26833 mini_ranger.cc:193] Using host: 127.26.52.84
I20260807 22:38:55.489607 26833 mini_ranger.cc:227] Ranger admin URL: http://127.26.52.84:46925
Aug 07, 2026 10:38:55 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:38:55 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:38:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 10:38:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 10:38:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 10:38:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 10:38:56 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 22:38:56.650719 26833 mini_ranger.cc:160] Time spent starting Ranger: real 8.694s user 0.006s sys 0.006s
Aug 07, 2026 10:39:17 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 10:39:17 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 10:39:17 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 10:39:17 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 10:39:18 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 22:39:19.329841 26833 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.52.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.52.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/rangerkms_127.26.52.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/rangerkms_127.26.52.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.52.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.52.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.52.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/HTTP_127.26.52.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.52.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/HTTP_127.26.52.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 22:39:19 dist-test-slave-8w9v krb5kdc[5961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142359, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 22:39:19.414935 26833 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 22:39:19.426012 26833 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 22:39:20.279027 26833 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 22:39:20.279114 26833 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-kms
I20260807 22:39:20.279219 26833 mini_ranger_kms.cc:227] Using postgres at 127.26.52.84:54741
2026-08-07 22:39:20,569 [I] DB FLAVOR :POSTGRES
2026-08-07 22:39:20,569 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:39:20,569 [I] Checking connection
2026-08-07 22:39:20,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 22:39:20,832 [I] connection success
2026-08-07 22:39:20,832 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 22:39:20,832 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 22:39:20,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 22:39:21,068 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 22:39:21,068 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:39:21,069 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 22:39:21,069 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:54741/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 22:39:21,330 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 22:39:21.824604 26833 mini_ranger_kms.cc:310] Created kms service
I20260807 22:39:22.037114 26833 mini_ranger_kms.cc:326] Created kudu user
I20260807 22:39:22.082880 26833 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 22:39:22 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142359, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:39:22.529199 26833 mini_ranger_kms.cc:384] Added ranger policy
I20260807 22:39:22.529362 26833 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-kms:/tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 22:39:22.529384 26833 mini_ranger_kms.cc:240] Using host: 127.26.52.84
I20260807 22:39:22.535157 26833 mini_ranger_kms.cc:276] Ranger KMS PID: 6384
I20260807 22:39:22.535296 26833 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.52.84:42177
Aug 07, 2026 10:39:23 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:39:23 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:39:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 10:39:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 10:39:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 10:39:24 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260807 22:39:24.853152 26833 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.438s user 0.000s sys 0.268s
I20260807 22:39:24.853296 26833 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 22:39:24.853407 26833 mini_ranger_kms.cc:401] 127.26.52.84:42177/kms/v1/keys
Aug 07 22:39:24 dist-test-slave-8w9v krb5kdc[5961](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142364, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.52.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 22:39:25 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142364, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.52.84@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
Aug 07 22:39:25 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142364, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.52.84@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
Aug 07 22:39:28 dist-test-slave-8w9v krb5kdc[5961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:39:28.079324 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:34659
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:34659
--ranger_config_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:42177/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:39:28.192600 6442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:39:28.192849 6442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:39:28.192888 6442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:39:28.197078 6442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:39:28.197135 6442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:39:28.197155 6442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:39:28.197171 6442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:39:28.197186 6442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:39:28.202416 6442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.52.84:42177/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:34659
--ranger_config_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:34659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:39:28.203562 6442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:39:28.204682 6442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:39:28.214293 6442 server_base.cc:1034] running on GCE node
W20260807 22:39:28.214316 6448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:39:28.214358 6451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:39:28.214316 6449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:39:28.215188 6442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:39:28.216384 6442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:39:28.217552 6442 hybrid_clock.cc:648] HybridClock initialized: now 1786142368217528 us; error 41 us; skew 500 ppm
Aug 07 22:39:28 dist-test-slave-8w9v krb5kdc[5961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142368, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:39:28.225347 6442 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:39:28.226228 6442 webserver.cc:460] Webserver started at http://127.26.52.126:40959/ using document root <none> and password file <none>
I20260807 22:39:28.226783 6442 fs_manager.cc:359] Metadata directory not provided
I20260807 22:39:28.226838 6442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:39:28.227068 6442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:39:28 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142368, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:39:28.283257 6442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "3c22bafd30ce45558c61420985071486"
format_stamp: "Formatted at 2026-08-07 22:39:28 on dist-test-slave-8w9v"
server_key: "6d0240f198f5b6952c6a2a399566a163"
server_key_iv: "752d3c7648e66156ad946c745d8442cd"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:28.284192 6442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "3c22bafd30ce45558c61420985071486"
format_stamp: "Formatted at 2026-08-07 22:39:28 on dist-test-slave-8w9v"
server_key: "6d0240f198f5b6952c6a2a399566a163"
server_key_iv: "752d3c7648e66156ad946c745d8442cd"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:28.289263 6442 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260807 22:39:28.303625 6458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:39:28.305073 6442 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:39:28.305228 6442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "3c22bafd30ce45558c61420985071486"
format_stamp: "Formatted at 2026-08-07 22:39:28 on dist-test-slave-8w9v"
server_key: "6d0240f198f5b6952c6a2a399566a163"
server_key_iv: "752d3c7648e66156ad946c745d8442cd"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:28.305377 6442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:39:28.326161 6442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:39:28.329248 6442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:39:28.329471 6442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:39:28.338322 6442 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:34659
I20260807 22:39:28.338348 6519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:34659 every 8 connection(s)
I20260807 22:39:28.339298 6442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:39:28.342810 6520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:39:28.347002 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 6442
I20260807 22:39:28.347148 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:39:28.347450 26833 external_mini_cluster.cc:1428] Setting key 47286adbb2df9cbf06400013bf4c8b49
I20260807 22:39:28.349813 6520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486: Bootstrap starting.
I20260807 22:39:28.352591 6520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486: Neither blocks nor log segments found. Creating new log.
I20260807 22:39:28.353483 6520 log.cc:824] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486: Log is configured to *not* fsync() on all Append() calls
I20260807 22:39:28.355870 6520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486: No bootstrap required, opened a new log
Aug 07 22:39:28 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:39:28.360433 6520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c22bafd30ce45558c61420985071486" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34659 } }
I20260807 22:39:28.360695 6520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:39:28.360802 6520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c22bafd30ce45558c61420985071486, State: Initialized, Role: FOLLOWER
I20260807 22:39:28.361295 6520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c22bafd30ce45558c61420985071486" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34659 } }
I20260807 22:39:28.361382 6523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:28.348879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48992 (local address 127.26.52.126:34659)
0807 22:39:28.349264 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:28.349279 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:28.349313 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:39:28.349925 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:28.349949 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:28.350262 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:28.350570 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:39:28.351401 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:28.352430 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:28.353355 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:28.353906 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:28.354089 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:28.356774 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:39:28.356779 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:39:28.356792 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:39:28.356817 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:39:28.358399 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:39:28.358829 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:39:28.358839 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:39:28.358843 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:39:28.358946 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:39:28.359244 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:39:28.359248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:39:28.359250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:39:28.359616 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:39:28.359924 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:28.360150 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 22:39:28.360442 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":119,"threads_started":1}
I20260807 22:39:28.361452 6520 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:39:28.361508 6520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:39:28.361636 6520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:39:28.362778 6520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c22bafd30ce45558c61420985071486" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34659 } }
I20260807 22:39:28.363142 6520 leader_election.cc:302] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c22bafd30ce45558c61420985071486; no voters:
I20260807 22:39:28.363488 6520 leader_election.cc:288] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:39:28.363813 6526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:39:28.364079 6526 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [term 1 LEADER]: Becoming Leader. State: Replica: 3c22bafd30ce45558c61420985071486, State: Running, Role: LEADER
I20260807 22:39:28.364441 6526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c22bafd30ce45558c61420985071486" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34659 } }
I20260807 22:39:28.364771 6520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:39:28.365521 6526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c22bafd30ce45558c61420985071486. Latest consensus state: current_term: 1 leader_uuid: "3c22bafd30ce45558c61420985071486" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c22bafd30ce45558c61420985071486" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34659 } } }
I20260807 22:39:28.365722 6526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [sys.catalog]: This master's current role is: LEADER
I20260807 22:39:28.366000 6527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c22bafd30ce45558c61420985071486" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c22bafd30ce45558c61420985071486" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34659 } } }
I20260807 22:39:28.366087 6527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486 [sys.catalog]: This master's current role is: LEADER
I20260807 22:39:28.366184 6535 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:39:28.369880 6535 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:39:28.370400 6520 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 22:39:28.380905 6535 catalog_manager.cc:1347] Generated new cluster ID: f4d86f167a844da48185efabacf14e18
I20260807 22:39:28.381057 6535 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:39:28.389462 6535 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:39:28.391032 6535 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:39:28.402338 6535 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486: Generated new TSK 0
I20260807 22:39:28.404681 6535 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:39:29.161249 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:42177/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:34659
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:39:29.283316 6568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:39:29.283555 6568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:39:29.283595 6568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:39:29.287782 6568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:39:29.287858 6568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:39:29.287955 6568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:39:29.293227 6568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.52.84:42177/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:34659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:39:29.294287 6568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:39:29.295315 6568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:39:29.306481 6573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:39:29.306696 6576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:39:29.306556 6574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:39:29.307973 6568 server_base.cc:1034] running on GCE node
I20260807 22:39:29.308585 6568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:39:29.309343 6568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:39:29.312659 6568 hybrid_clock.cc:648] HybridClock initialized: now 1786142369312627 us; error 41 us; skew 500 ppm
Aug 07 22:39:29 dist-test-slave-8w9v krb5kdc[5961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142369, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:39:29.315920 6568 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:39:29.316969 6568 webserver.cc:460] Webserver started at http://127.26.52.65:37565/ using document root <none> and password file <none>
I20260807 22:39:29.317703 6568 fs_manager.cc:359] Metadata directory not provided
I20260807 22:39:29.317852 6568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:39:29.318135 6568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:39:29 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142369, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:39:29.334817 6568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "84d5f5c06d84418e8a8cffbbfd893be7"
format_stamp: "Formatted at 2026-08-07 22:39:29 on dist-test-slave-8w9v"
server_key: "88117d51c599277745e093c97462f4bb"
server_key_iv: "3f6b55b99c72c25d0fbffb29d5400fe7"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:29.335561 6568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "84d5f5c06d84418e8a8cffbbfd893be7"
format_stamp: "Formatted at 2026-08-07 22:39:29 on dist-test-slave-8w9v"
server_key: "88117d51c599277745e093c97462f4bb"
server_key_iv: "3f6b55b99c72c25d0fbffb29d5400fe7"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:29.340965 6568 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 22:39:29.359160 6585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:39:29.364342 6568 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260807 22:39:29.364584 6568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "84d5f5c06d84418e8a8cffbbfd893be7"
format_stamp: "Formatted at 2026-08-07 22:39:29 on dist-test-slave-8w9v"
server_key: "88117d51c599277745e093c97462f4bb"
server_key_iv: "3f6b55b99c72c25d0fbffb29d5400fe7"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:29.364823 6568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:39:29.392228 6568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:39:29.395542 6568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:39:29.395793 6568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:39:29.396674 6568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:39:29.397854 6568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:39:29.397962 6568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:39:29.398135 6568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:39:29.398242 6568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:39:29.422889 6568 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:41791
I20260807 22:39:29.424254 6568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:39:29.424623 6703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:41791 every 8 connection(s)
I20260807 22:39:29.433465 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 6568
I20260807 22:39:29.433609 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:39:29.433962 26833 external_mini_cluster.cc:1428] Setting key a23b577befb30d5d6fcab9e35e48de91
Aug 07 22:39:29 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142369, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:39:29.455933 6706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:29.427283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:34659 (local address 127.26.52.65:47809)
0807 22:39:29.440543 (+ 13260us) negotiation.cc:107] Waiting for socket to connect
0807 22:39:29.440626 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0807 22:39:29.441858 (+ 1232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:39:29.442786 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:39:29.442798 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:39:29.443179 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:39:29.443930 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:29.443953 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:29.445161 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:29.445165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:29.446561 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:29.446571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:29.447386 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:29.447390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:29.447583 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:29.448332 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:39:29.448351 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:39:29.450101 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:39:29.452624 (+ 2523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:39:29.452630 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:39:29.452646 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:39:29.452976 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:39:29.453298 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:39:29.453302 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:39:29.453304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:39:29.453496 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:39:29.453985 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:39:29.453992 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:39:29.454295 (+ 303us) client_negotiation.cc:769] Sending connection context
0807 22:39:29.454498 (+ 203us) client_negotiation.cc:240] Negotiation successful
0807 22:39:29.454829 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12944,"thread_start_us":233,"threads_started":1}
I20260807 22:39:29.456861 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:29.428565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:47809 (local address 127.26.52.126:34659)
0807 22:39:29.428858 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:29.428863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:29.440748 (+ 11885us) server_negotiation.cc:407] Connection header received
0807 22:39:29.442162 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:29.442166 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:29.442238 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:29.442306 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:39:29.444157 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:29.445004 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:29.446706 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:29.447089 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:29.447169 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:29.450306 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:39:29.450311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:39:29.450313 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:39:29.450340 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:39:29.452481 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:39:29.453096 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:39:29.453099 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:39:29.453101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:39:29.453191 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:39:29.453606 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:39:29.453610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:39:29.453612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:39:29.453841 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:39:29.453931 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:29.456550 (+ 2619us) server_negotiation.cc:299] Negotiation successful
0807 22:39:29.456681 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":119,"threads_started":1}
I20260807 22:39:29.458953 6704 heartbeater.cc:347] Connected to a master server at 127.26.52.126:34659
I20260807 22:39:29.459200 6704 heartbeater.cc:464] Registering TS with master...
I20260807 22:39:29.459820 6704 heartbeater.cc:511] Master 127.26.52.126:34659 requested a full tablet report, sending...
I20260807 22:39:29.463325 6479 ts_manager.cc:194] Registered new tserver with Master: 84d5f5c06d84418e8a8cffbbfd893be7 (127.26.52.65:41791)
I20260807 22:39:29.464886 6479 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:47809
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:39:29.487584 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:42177/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:34659
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:39:29 dist-test-slave-8w9v krb5kdc[5961](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142369, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 22:39:29.639312 6712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:39:29.639600 6712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:39:29.639698 6712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:39:29.643723 6712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:39:29.643811 6712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:39:29.643914 6712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:39:29.650486 6712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.52.84:42177/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:34659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:39:29.651657 6712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:39:29.652907 6712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:39:29.663784 6722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:39:29.663730 6718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:39:29.664003 6720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:39:29.664008 6712 server_base.cc:1034] running on GCE node
I20260807 22:39:29.664857 6712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:39:29.665555 6712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:39:29.666718 6712 hybrid_clock.cc:648] HybridClock initialized: now 1786142369666703 us; error 67 us; skew 500 ppm
Aug 07 22:39:29 dist-test-slave-8w9v krb5kdc[5961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142369, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:39:29.669852 6712 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:39:29.670938 6712 webserver.cc:460] Webserver started at http://127.26.52.66:45805/ using document root <none> and password file <none>
I20260807 22:39:29.671586 6712 fs_manager.cc:359] Metadata directory not provided
I20260807 22:39:29.671674 6712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:39:29.671921 6712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:39:29 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142369, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:39:29.695737 6712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "4b4bc7d1b4a742a4b902c804d0a8261c"
format_stamp: "Formatted at 2026-08-07 22:39:29 on dist-test-slave-8w9v"
server_key: "b696f81e2976d20d432ae74ee78eb1ad"
server_key_iv: "b956906d740433d1fed56f1cb1aa2c68"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:29.701076 6712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "4b4bc7d1b4a742a4b902c804d0a8261c"
format_stamp: "Formatted at 2026-08-07 22:39:29 on dist-test-slave-8w9v"
server_key: "b696f81e2976d20d432ae74ee78eb1ad"
server_key_iv: "b956906d740433d1fed56f1cb1aa2c68"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:29.708498 6712 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.004s
I20260807 22:39:29.732923 6730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:39:29.734937 6712 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.003s sys 0.001s
I20260807 22:39:29.740295 6712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "4b4bc7d1b4a742a4b902c804d0a8261c"
format_stamp: "Formatted at 2026-08-07 22:39:29 on dist-test-slave-8w9v"
server_key: "b696f81e2976d20d432ae74ee78eb1ad"
server_key_iv: "b956906d740433d1fed56f1cb1aa2c68"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:29.740506 6712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:39:29.763954 6712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:39:29.767861 6712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:39:29.768066 6712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:39:29.768937 6712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:39:29.770012 6712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:39:29.770080 6712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:39:29.770141 6712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:39:29.770174 6712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:39:29.786722 6712 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:36833
I20260807 22:39:29.789150 6847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:36833 every 8 connection(s)
I20260807 22:39:29.789950 6712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:39:29.793362 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 6712
I20260807 22:39:29.793510 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:39:29.793919 26833 external_mini_cluster.cc:1428] Setting key 9cbcd234035cf8276900cd64cda49b87
Aug 07 22:39:29 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142369, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:39:29.809000 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:29.792746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:35723 (local address 127.26.52.126:34659)
0807 22:39:29.792911 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:29.792916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:29.794605 (+ 1689us) server_negotiation.cc:407] Connection header received
0807 22:39:29.795827 (+ 1222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:29.795831 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:29.795887 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:29.795983 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:39:29.797652 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:29.798516 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:29.800319 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:29.800675 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:29.800768 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:29.804089 (+ 3321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:39:29.804093 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:39:29.804096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:39:29.804146 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:39:29.806094 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:39:29.806797 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:39:29.806802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:39:29.806804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:39:29.806902 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:39:29.807385 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:39:29.807389 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:39:29.807391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:39:29.807620 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:39:29.807698 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:29.808521 (+ 823us) server_negotiation.cc:299] Negotiation successful
0807 22:39:29.808673 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:39:29.811332 6850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:29.793229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:34659 (local address 127.26.52.66:35723)
0807 22:39:29.794437 (+ 1208us) negotiation.cc:107] Waiting for socket to connect
0807 22:39:29.794495 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 22:39:29.795581 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:39:29.796254 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:39:29.796273 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:39:29.796676 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:39:29.797457 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:29.797480 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:29.798708 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:29.798713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:29.800155 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:29.800169 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:29.800999 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:29.801004 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:29.801233 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:29.801969 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:39:29.801990 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:39:29.803863 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:39:29.806259 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:39:29.806277 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:39:29.806294 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:39:29.806652 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:39:29.807038 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:39:29.807041 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:39:29.807043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:39:29.807234 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:39:29.807791 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:39:29.807797 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:39:29.808185 (+ 388us) client_negotiation.cc:769] Sending connection context
0807 22:39:29.809721 (+ 1536us) client_negotiation.cc:240] Negotiation successful
0807 22:39:29.810144 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":978,"thread_start_us":128,"threads_started":1}
I20260807 22:39:29.812841 6848 heartbeater.cc:347] Connected to a master server at 127.26.52.126:34659
I20260807 22:39:29.813094 6848 heartbeater.cc:464] Registering TS with master...
I20260807 22:39:29.813654 6848 heartbeater.cc:511] Master 127.26.52.126:34659 requested a full tablet report, sending...
I20260807 22:39:29.814826 6479 ts_manager.cc:194] Registered new tserver with Master: 4b4bc7d1b4a742a4b902c804d0a8261c (127.26.52.66:36833)
I20260807 22:39:29.815586 6479 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:35723
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:39:29.855924 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:42177/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:34659
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:39:30.031985 6853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:39:30.032335 6853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:39:30.032405 6853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:39:30.038564 6853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:39:30.038646 6853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:39:30.038749 6853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
Aug 07 22:39:30 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142369, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:39:30.047093 6853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.52.84:42177/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:34659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:39:30.048549 6853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:39:30.050132 6853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:39:30.061776 6862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:39:30.061903 6858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:39:30.062199 6859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:39:30.062496 6853 server_base.cc:1034] running on GCE node
I20260807 22:39:30.062924 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:39:30.063697 6853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:39:30.067022 6853 hybrid_clock.cc:648] HybridClock initialized: now 1786142370066978 us; error 49 us; skew 500 ppm
Aug 07 22:39:30 dist-test-slave-8w9v krb5kdc[5961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142370, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:39:30.071587 6853 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:39:30.072840 6853 webserver.cc:460] Webserver started at http://127.26.52.67:44931/ using document root <none> and password file <none>
I20260807 22:39:30.073590 6853 fs_manager.cc:359] Metadata directory not provided
I20260807 22:39:30.073674 6853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:39:30.073951 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:39:30 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142370, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:39:30.091770 6853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "fc85e983f34e4cc180e7fb29a204bdfe"
format_stamp: "Formatted at 2026-08-07 22:39:30 on dist-test-slave-8w9v"
server_key: "7e375d9d705bdd5de238e0817c0ddd6d"
server_key_iv: "0321e003ac8707864e18d7aa49d5818f"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:30.092481 6853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "fc85e983f34e4cc180e7fb29a204bdfe"
format_stamp: "Formatted at 2026-08-07 22:39:30 on dist-test-slave-8w9v"
server_key: "7e375d9d705bdd5de238e0817c0ddd6d"
server_key_iv: "0321e003ac8707864e18d7aa49d5818f"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:30.102041 6853 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.001s
I20260807 22:39:30.124564 6869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:39:30.126210 6853 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.002s sys 0.001s
I20260807 22:39:30.126361 6853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "fc85e983f34e4cc180e7fb29a204bdfe"
format_stamp: "Formatted at 2026-08-07 22:39:30 on dist-test-slave-8w9v"
server_key: "7e375d9d705bdd5de238e0817c0ddd6d"
server_key_iv: "0321e003ac8707864e18d7aa49d5818f"
server_key_version: "kuduclusterkey@0"
I20260807 22:39:30.126495 6853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:39:30.148039 6853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:39:30.151535 6853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:39:30.151777 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:39:30.152498 6853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:39:30.153571 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:39:30.153673 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:39:30.153774 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:39:30.153839 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:39:30.178478 6853 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:40519
I20260807 22:39:30.179652 6853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:39:30.180467 6992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:40519 every 8 connection(s)
I20260807 22:39:30.188350 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 6853
I20260807 22:39:30.188475 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:39:30.188768 26833 external_mini_cluster.cc:1428] Setting key 541d77b75a71f777c812caab5627f747
Aug 07 22:39:30 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142370, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:39:30.200673 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.182970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:40363 (local address 127.26.52.126:34659)
0807 22:39:30.183108 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:30.183112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:30.184957 (+ 1845us) server_negotiation.cc:407] Connection header received
0807 22:39:30.186160 (+ 1203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:30.186163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:30.186221 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:30.186293 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:39:30.187898 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.188629 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.192348 (+ 3719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.192702 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.192780 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.195979 (+ 3199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:39:30.195985 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:39:30.195988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:39:30.196021 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:39:30.198016 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:39:30.198623 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:39:30.198627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:39:30.198629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:39:30.198743 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:39:30.199155 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:39:30.199159 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:39:30.199161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:39:30.199408 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:39:30.199521 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:30.200314 (+ 793us) server_negotiation.cc:299] Negotiation successful
0807 22:39:30.200459 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:39:30.203120 6995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.183447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:34659 (local address 127.26.52.67:40363)
0807 22:39:30.184780 (+ 1333us) negotiation.cc:107] Waiting for socket to connect
0807 22:39:30.184840 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 22:39:30.185908 (+ 1068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:39:30.186697 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:39:30.186706 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:39:30.187060 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:39:30.187730 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.187749 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.188783 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.188786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.192202 (+ 3416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.192214 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.192988 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.192992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.193187 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.193929 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:39:30.193949 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:39:30.195759 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:39:30.198154 (+ 2395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:39:30.198160 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:39:30.198175 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:39:30.198506 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:39:30.198856 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:39:30.198859 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:39:30.198861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:39:30.199043 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:39:30.199599 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:39:30.199608 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:39:30.199951 (+ 343us) client_negotiation.cc:769] Sending connection context
0807 22:39:30.201057 (+ 1106us) client_negotiation.cc:240] Negotiation successful
0807 22:39:30.201677 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1105,"thread_start_us":156,"threads_started":1}
I20260807 22:39:30.204775 6993 heartbeater.cc:347] Connected to a master server at 127.26.52.126:34659
I20260807 22:39:30.205042 6993 heartbeater.cc:464] Registering TS with master...
I20260807 22:39:30.205636 6993 heartbeater.cc:511] Master 127.26.52.126:34659 requested a full tablet report, sending...
I20260807 22:39:30.206954 6479 ts_manager.cc:194] Registered new tserver with Master: fc85e983f34e4cc180e7fb29a204bdfe (127.26.52.67:40519)
I20260807 22:39:30.207875 6479 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:40363
I20260807 22:39:30.214875 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:39:30.228040 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.217705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49002 (local address 127.26.52.126:34659)
0807 22:39:30.217835 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:30.217839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:30.218169 (+ 330us) server_negotiation.cc:407] Connection header received
0807 22:39:30.218292 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:30.218295 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:30.218345 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:30.218438 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:39:30.219384 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.220258 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.221573 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.221920 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.222035 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.223922 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:39:30.223927 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:39:30.223930 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:39:30.223956 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:39:30.225962 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:39:30.226496 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:39:30.226500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:39:30.226502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:39:30.226594 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:39:30.226936 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:39:30.226939 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:39:30.226941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:39:30.227161 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:39:30.227304 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:30.227582 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 22:39:30.227702 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:39:30.231216 6479 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49002:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:39:30.235721 6479 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:39:30.264173 7008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.254719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:36833 (local address 127.0.0.1:46518)
0807 22:39:30.257049 (+ 2330us) negotiation.cc:107] Waiting for socket to connect
0807 22:39:30.257063 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:39:30.257150 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:39:30.258694 (+ 1544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:39:30.258697 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:39:30.258717 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:39:30.259112 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.259123 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.260869 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.260873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.262289 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.262301 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.263557 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.263562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.263696 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.263750 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 22:39:30.263858 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 22:39:30.263987 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2261,"mutex_wait_us":57,"thread_start_us":118,"threads_started":1}
I20260807 22:39:30.267565 7009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.255569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46518 (local address 127.26.52.66:36833)
0807 22:39:30.257997 (+ 2428us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:30.258013 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:30.258041 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:39:30.258128 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:30.258134 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:30.258355 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:30.258522 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:39:30.259263 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.260724 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.262468 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.263359 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.267072 (+ 3713us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.267243 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:30.267300 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 22:39:30.267400 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1710,"thread_start_us":128,"threads_started":1}
I20260807 22:39:30.269831 7011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.256477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:41791 (local address 127.0.0.1:49120)
0807 22:39:30.262028 (+ 5551us) negotiation.cc:107] Waiting for socket to connect
0807 22:39:30.262048 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 22:39:30.262174 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:39:30.264409 (+ 2235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:39:30.264412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:39:30.264432 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:39:30.264533 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.264540 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.266223 (+ 1683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.266227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.267313 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.267325 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.269413 (+ 2088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.269417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.269506 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.269533 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:39:30.269607 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:39:30.269684 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5463,"thread_start_us":104,"threads_started":1}
I20260807 22:39:30.270507 7012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.257066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49120 (local address 127.26.52.65:41791)
0807 22:39:30.259247 (+ 2181us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:30.259254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:30.262309 (+ 3055us) server_negotiation.cc:407] Connection header received
0807 22:39:30.262419 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:30.262428 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:30.262675 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:30.262881 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:39:30.264880 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.266081 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.268337 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.269098 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.269210 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.269346 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:30.270159 (+ 813us) server_negotiation.cc:299] Negotiation successful
0807 22:39:30.270297 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2069,"thread_start_us":140,"threads_started":1}
I20260807 22:39:30.271152 6780 tablet_service.cc:1467] Processing CreateTablet for tablet bd4cc1d3b0344b2794dc7e2102eb69ed (DEFAULT_TABLE table=test-table [id=1d41a0afab074313be6daa93f4df18cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:39:30.272415 6780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd4cc1d3b0344b2794dc7e2102eb69ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:39:30.273366 6634 tablet_service.cc:1467] Processing CreateTablet for tablet bd4cc1d3b0344b2794dc7e2102eb69ed (DEFAULT_TABLE table=test-table [id=1d41a0afab074313be6daa93f4df18cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:39:30.274441 6634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd4cc1d3b0344b2794dc7e2102eb69ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:39:30.283146 7007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.254653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:40519 (local address 127.0.0.1:44720)
0807 22:39:30.256591 (+ 1938us) negotiation.cc:107] Waiting for socket to connect
0807 22:39:30.256646 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 22:39:30.256781 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:39:30.258633 (+ 1852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:39:30.258640 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:39:30.258666 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:39:30.260226 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.260238 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.264754 (+ 4516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.264758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.266052 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.266063 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.282649 (+ 16586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.282654 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.282770 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.282798 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 22:39:30.282892 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:39:30.282986 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1753,"mutex_wait_us":110,"spinlock_wait_cycles":1536,"thread_start_us":118,"threads_started":1}
I20260807 22:39:30.284003 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.255661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44720 (local address 127.26.52.67:40519)
0807 22:39:30.258080 (+ 2419us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:30.258098 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:30.258131 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:39:30.258216 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:30.258223 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:30.258423 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:30.258924 (+ 501us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:39:30.261029 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.263371 (+ 2342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.266222 (+ 2851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.282250 (+ 16028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.282393 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.282565 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:30.283704 (+ 1139us) server_negotiation.cc:299] Negotiation successful
0807 22:39:30.283856 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2277,"thread_start_us":165,"threads_started":1}
I20260807 22:39:30.285651 7013 tablet_bootstrap.cc:492] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: Bootstrap starting.
I20260807 22:39:30.287431 6925 tablet_service.cc:1467] Processing CreateTablet for tablet bd4cc1d3b0344b2794dc7e2102eb69ed (DEFAULT_TABLE table=test-table [id=1d41a0afab074313be6daa93f4df18cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:39:30.288540 6925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd4cc1d3b0344b2794dc7e2102eb69ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:39:30.288712 7013 tablet_bootstrap.cc:654] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: Neither blocks nor log segments found. Creating new log.
I20260807 22:39:30.290338 7013 log.cc:824] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:39:30.291152 7014 tablet_bootstrap.cc:492] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7: Bootstrap starting.
I20260807 22:39:30.293594 7014 tablet_bootstrap.cc:654] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7: Neither blocks nor log segments found. Creating new log.
I20260807 22:39:30.294518 7014 log.cc:824] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7: Log is configured to *not* fsync() on all Append() calls
I20260807 22:39:30.296738 7013 tablet_bootstrap.cc:492] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: No bootstrap required, opened a new log
I20260807 22:39:30.296942 7013 ts_tablet_manager.cc:1397] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260807 22:39:30.298851 7014 tablet_bootstrap.cc:492] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7: No bootstrap required, opened a new log
I20260807 22:39:30.299108 7014 ts_tablet_manager.cc:1397] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260807 22:39:30.300877 7013 raft_consensus.cc:348] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 } } peers { permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 } } peers { permanent_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 41791 } }
I20260807 22:39:30.302004 7013 raft_consensus.cc:374] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:39:30.302109 7013 raft_consensus.cc:729] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b4bc7d1b4a742a4b902c804d0a8261c, State: Initialized, Role: FOLLOWER
I20260807 22:39:30.302634 7013 consensus_queue.cc:260] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 } } peers { permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 } } peers { permanent_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 41791 } }
I20260807 22:39:30.303727 7013 ts_tablet_manager.cc:1428] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:39:30.303679 7014 raft_consensus.cc:348] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 } } peers { permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 } } peers { permanent_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 41791 } }
I20260807 22:39:30.304006 7014 raft_consensus.cc:374] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:39:30.304118 7014 raft_consensus.cc:729] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d5f5c06d84418e8a8cffbbfd893be7, State: Initialized, Role: FOLLOWER
I20260807 22:39:30.304255 6848 heartbeater.cc:503] Master 127.26.52.126:34659 was elected leader, sending a full tablet report...
I20260807 22:39:30.304623 7014 consensus_queue.cc:260] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 } } peers { permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 } } peers { permanent_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 41791 } }
I20260807 22:39:30.305718 7014 ts_tablet_manager.cc:1428] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:39:30.307149 6704 heartbeater.cc:503] Master 127.26.52.126:34659 was elected leader, sending a full tablet report...
I20260807 22:39:30.307400 7017 tablet_bootstrap.cc:492] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: Bootstrap starting.
I20260807 22:39:30.311839 7017 tablet_bootstrap.cc:654] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: Neither blocks nor log segments found. Creating new log.
I20260807 22:39:30.313016 7017 log.cc:824] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: Log is configured to *not* fsync() on all Append() calls
I20260807 22:39:30.314988 7017 tablet_bootstrap.cc:492] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: No bootstrap required, opened a new log
I20260807 22:39:30.315264 7017 ts_tablet_manager.cc:1397] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 22:39:30.319615 7017 raft_consensus.cc:348] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 } } peers { permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 } } peers { permanent_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 41791 } }
I20260807 22:39:30.319860 7017 raft_consensus.cc:374] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:39:30.319929 7017 raft_consensus.cc:729] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc85e983f34e4cc180e7fb29a204bdfe, State: Initialized, Role: FOLLOWER
I20260807 22:39:30.320396 7017 consensus_queue.cc:260] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 } } peers { permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 } } peers { permanent_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 41791 } }
I20260807 22:39:30.321095 6993 heartbeater.cc:503] Master 127.26.52.126:34659 was elected leader, sending a full tablet report...
I20260807 22:39:30.321496 7017 ts_tablet_manager.cc:1428] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
Aug 07 22:39:30 dist-test-slave-8w9v krb5kdc[5961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142369, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:39:30.395237 7019 raft_consensus.cc:482] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:39:30.395531 7019 raft_consensus.cc:504] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 } } peers { permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 } } peers { permanent_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 41791 } }
I20260807 22:39:30.397557 7019 leader_election.cc:288] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc85e983f34e4cc180e7fb29a204bdfe (127.26.52.67:40519), 4b4bc7d1b4a742a4b902c804d0a8261c (127.26.52.66:36833)
I20260807 22:39:30.404016 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.399045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:59561 (local address 127.26.52.67:40519)
0807 22:39:30.399342 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:30.399347 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:30.399375 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:39:30.399432 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:30.399435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:30.399481 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:30.399552 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:39:30.400553 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.401330 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.402812 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.403346 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.403429 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.403495 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:30.403818 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 22:39:30.403890 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221}
I20260807 22:39:30.404512 7023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.398048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:40519 (local address 127.26.52.65:59561)
0807 22:39:30.398498 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 22:39:30.398515 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:39:30.398715 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:39:30.400067 (+ 1352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:39:30.400070 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:39:30.400087 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:39:30.400416 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.400424 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.401497 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.401500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.402665 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.402675 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.403582 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.403586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.403675 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.403696 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:39:30.404253 (+ 557us) client_negotiation.cc:240] Negotiation successful
0807 22:39:30.404331 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":160,"threads_started":1}
I20260807 22:39:30.405272 6945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4cc1d3b0344b2794dc7e2102eb69ed" candidate_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" is_pre_election: true
I20260807 22:39:30.405493 7009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.399215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:50907 (local address 127.26.52.66:36833)
0807 22:39:30.399720 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:30.399724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:30.399738 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:39:30.399800 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:30.399802 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:30.399859 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:30.399955 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:39:30.401495 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.402155 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.403909 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.404576 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.404700 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.404784 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:30.405255 (+ 471us) server_negotiation.cc:299] Negotiation successful
0807 22:39:30.405357 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424}
I20260807 22:39:30.405616 6945 raft_consensus.cc:2454] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84d5f5c06d84418e8a8cffbbfd893be7 in term 0.
I20260807 22:39:30.405997 7024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.398570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:36833 (local address 127.26.52.65:50907)
0807 22:39:30.399245 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0807 22:39:30.399261 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:39:30.399414 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:39:30.401144 (+ 1730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:39:30.401148 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:39:30.401169 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:39:30.401329 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.401336 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.402326 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.402330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.403733 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:39:30.403747 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.404886 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.404891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:39:30.405081 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.405109 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 22:39:30.405643 (+ 534us) client_negotiation.cc:240] Negotiation successful
0807 22:39:30.405735 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":138,"threads_started":1}
I20260807 22:39:30.406203 6588 leader_election.cc:302] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d5f5c06d84418e8a8cffbbfd893be7, fc85e983f34e4cc180e7fb29a204bdfe; no voters:
I20260807 22:39:30.406492 7019 raft_consensus.cc:2781] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:39:30.406607 7019 raft_consensus.cc:482] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:39:30.406670 7019 raft_consensus.cc:3037] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:39:30.406854 6789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4cc1d3b0344b2794dc7e2102eb69ed" candidate_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" is_pre_election: true
I20260807 22:39:30.407200 6789 raft_consensus.cc:2454] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84d5f5c06d84418e8a8cffbbfd893be7 in term 0.
I20260807 22:39:30.408797 7019 raft_consensus.cc:504] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 } } peers { permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 } } peers { permanent_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 41791 } }
I20260807 22:39:30.409446 7019 leader_election.cc:288] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [CANDIDATE]: Term 1 election: Requested vote from peers fc85e983f34e4cc180e7fb29a204bdfe (127.26.52.67:40519), 4b4bc7d1b4a742a4b902c804d0a8261c (127.26.52.66:36833)
I20260807 22:39:30.409667 6945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4cc1d3b0344b2794dc7e2102eb69ed" candidate_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc85e983f34e4cc180e7fb29a204bdfe"
I20260807 22:39:30.409842 6945 raft_consensus.cc:3037] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:39:30.410028 6789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4cc1d3b0344b2794dc7e2102eb69ed" candidate_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c"
I20260807 22:39:30.410159 6789 raft_consensus.cc:3037] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:39:30.411163 6945 raft_consensus.cc:2454] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d5f5c06d84418e8a8cffbbfd893be7 in term 1.
I20260807 22:39:30.411386 6789 raft_consensus.cc:2454] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d5f5c06d84418e8a8cffbbfd893be7 in term 1.
I20260807 22:39:30.411585 6588 leader_election.cc:302] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d5f5c06d84418e8a8cffbbfd893be7, fc85e983f34e4cc180e7fb29a204bdfe; no voters:
I20260807 22:39:30.411821 7019 raft_consensus.cc:2781] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:39:30.412072 7019 raft_consensus.cc:686] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [term 1 LEADER]: Becoming Leader. State: Replica: 84d5f5c06d84418e8a8cffbbfd893be7, State: Running, Role: LEADER
I20260807 22:39:30.413059 7019 consensus_queue.cc:237] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 } } peers { permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 } } peers { permanent_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 41791 } }
I20260807 22:39:30.419031 6479 catalog_manager.cc:5495] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84d5f5c06d84418e8a8cffbbfd893be7 (127.26.52.65). New cstate: current_term: 1 leader_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d5f5c06d84418e8a8cffbbfd893be7" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 41791 } health_report { overall_health: HEALTHY } } }
W20260807 22:39:30.427448 6705 tablet.cc:2369] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:39:30.432997 6994 tablet.cc:2369] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:39:30.462785 7012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.455826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49126 (local address 127.26.52.65:41791)
0807 22:39:30.455993 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 22:39:30.455998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:39:30.456042 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:39:30.456154 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:39:30.456158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:39:30.456225 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:39:30.456344 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:39:30.456645 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.457455 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.458774 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:39:30.459116 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:39:30.459251 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:39:30.459671 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:39:30.460334 (+ 663us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:39:30.460455 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 22:39:30.462545 (+ 2090us) server_negotiation.cc:299] Negotiation successful
0807 22:39:30.462617 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 22:39:30.472187 6789 raft_consensus.cc:1261] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c [term 1 FOLLOWER]: Refusing update from remote peer 84d5f5c06d84418e8a8cffbbfd893be7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:39:30.472384 6945 raft_consensus.cc:1261] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe [term 1 FOLLOWER]: Refusing update from remote peer 84d5f5c06d84418e8a8cffbbfd893be7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:39:30.473104 7019 consensus_queue.cc:1035] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b4bc7d1b4a742a4b902c804d0a8261c" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:39:30.473328 7025 consensus_queue.cc:1035] T bd4cc1d3b0344b2794dc7e2102eb69ed P 84d5f5c06d84418e8a8cffbbfd893be7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc85e983f34e4cc180e7fb29a204bdfe" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:39:30.490145 7029 mvcc.cc:205] Tried to move back new op lower bound from 7316039149443432448 to 7316039149224759296. Current Snapshot: MvccSnapshot[applied={T|T < 7316039149443432448}]
I20260807 22:39:30.497087 7030 mvcc.cc:205] Tried to move back new op lower bound from 7316039149443432448 to 7316039149224759296. Current Snapshot: MvccSnapshot[applied={T|T < 7316039149443432448}]
I20260807 22:39:30.505023 7034 mvcc.cc:205] Tried to move back new op lower bound from 7316039149443432448 to 7316039149224759296. Current Snapshot: MvccSnapshot[applied={T|T < 7316039149443432448}]
I20260807 22:39:30.518627 6479 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:39:30.518801 6479 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:39:30.521700 6479 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c22bafd30ce45558c61420985071486: Sending DeleteTablet for 3 replicas of tablet bd4cc1d3b0344b2794dc7e2102eb69ed
I20260807 22:39:30.522588 6634 tablet_service.cc:1514] Processing DeleteTablet for tablet bd4cc1d3b0344b2794dc7e2102eb69ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:39:30 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:49120
I20260807 22:39:30.522666 6780 tablet_service.cc:1514] Processing DeleteTablet for tablet bd4cc1d3b0344b2794dc7e2102eb69ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:39:30 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:46518
I20260807 22:39:30.522646 6925 tablet_service.cc:1514] Processing DeleteTablet for tablet bd4cc1d3b0344b2794dc7e2102eb69ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:39:30 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:44720
I20260807 22:39:30.524498 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 6568
I20260807 22:39:30.530872 7041 tablet_replica.cc:330] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: stopping tablet replica
I20260807 22:39:30.531328 7041 raft_consensus.cc:2229] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:39:30.531878 7041 raft_consensus.cc:2258] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:39:30.533797 7041 ts_tablet_manager.cc:1905] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:39:30.537555 7041 ts_tablet_manager.cc:1918] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:39:30.537672 7041 log.cc:1196] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/bd4cc1d3b0344b2794dc7e2102eb69ed
I20260807 22:39:30.538014 7041 ts_tablet_manager.cc:1939] T bd4cc1d3b0344b2794dc7e2102eb69ed P 4b4bc7d1b4a742a4b902c804d0a8261c: Deleting consensus metadata
I20260807 22:39:30.539585 7042 tablet_replica.cc:330] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: stopping tablet replica
I20260807 22:39:30.539558 6461 catalog_manager.cc:4841] TS 4b4bc7d1b4a742a4b902c804d0a8261c (127.26.52.66:36833): tablet bd4cc1d3b0344b2794dc7e2102eb69ed (table test-table [id=1d41a0afab074313be6daa93f4df18cf]) successfully deleted
I20260807 22:39:30.540000 7042 raft_consensus.cc:2229] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:39:30.540436 7042 raft_consensus.cc:2258] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:39:30.545689 7042 ts_tablet_manager.cc:1905] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:39:30.548571 7042 ts_tablet_manager.cc:1918] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:39:30.548679 7042 log.cc:1196] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/bd4cc1d3b0344b2794dc7e2102eb69ed
I20260807 22:39:30.549034 7042 ts_tablet_manager.cc:1939] T bd4cc1d3b0344b2794dc7e2102eb69ed P fc85e983f34e4cc180e7fb29a204bdfe: Deleting consensus metadata
I20260807 22:39:30.550386 6462 catalog_manager.cc:4841] TS fc85e983f34e4cc180e7fb29a204bdfe (127.26.52.67:40519): tablet bd4cc1d3b0344b2794dc7e2102eb69ed (table test-table [id=1d41a0afab074313be6daa93f4df18cf]) successfully deleted
W20260807 22:39:30.556905 6462 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:41791 (error 108)
I20260807 22:39:30.560536 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 6712
I20260807 22:39:30.566871 7007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:39:30.566489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:41791 (local address 127.0.0.1:49140)
0807 22:39:30.566700 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 22:39:30.566777 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:41791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
W20260807 22:39:30.567058 6462 catalog_manager.cc:4584] TS 84d5f5c06d84418e8a8cffbbfd893be7 (127.26.52.65:41791): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd4cc1d3b0344b2794dc7e2102eb69ed: Network error: Client connection negotiation failed: client connection to 127.26.52.65:41791: connect: Connection refused (error 111)
I20260807 22:39:30.585984 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 6853
I20260807 22:39:30.606649 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 6442
I20260807 22:39:30.618362 26833 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 22:39:30.963126 26833 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 22:39:30.963330 26833 mini_ranger.cc:66] Stopping Ranger...
I20260807 22:39:31.308490 26833 mini_ranger.cc:68] Stopped Ranger
2026-08-07 22:39:31.308 UTC [5991] LOG: received smart shutdown request
2026-08-07 22:39:31.313 UTC [5991] LOG: background worker "logical replication launcher" (PID 6001) exited with exit code 1
2026-08-07 22:39:31.313 UTC [5996] LOG: shutting down
2026-08-07 22:39:31.466 UTC [5991] LOG: database system is shut down
2026-08-07T22:39:31Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48342 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:39:31 dist-test-slave-8w9v krb5kdc[7052](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:39:31 dist-test-slave-8w9v krb5kdc[7052](info): set up 2 sockets
Aug 07 22:39:31 dist-test-slave-8w9v krb5kdc[7052](info): commencing operation
krb5kdc: starting...
W20260807 22:39:32.671053 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:39:32 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:39:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:39:32Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.52.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.52.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/rangeradmin_127.26.52.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/rangeradmin_127.26.52.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.52.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.52.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/rangerlookup_127.26.52.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/rangerlookup_127.26.52.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.52.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.52.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/HTTP_127.26.52.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/HTTP_127.26.52.84@KRBTEST.COM.keytab.
I20260807 22:39:32.842670 26833 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskDuvoCt/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/postgres -l logfile start
2026-08-07 22:39:35.306 UTC [7084] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 22:39:35.306 UTC [7084] LOG: listening on IPv4 address "127.26.52.84", port 37223
2026-08-07 22:39:35.310 UTC [7084] LOG: listening on Unix socket "/tmp/.s.PGSQL.37223"
2026-08-07 22:39:35.331 UTC [7087] LOG: database system was shut down at 2026-08-07 22:39:33 UTC
2026-08-07 22:39:35.335 UTC [7084] LOG: database system is ready to accept connections
I20260807 22:39:36.331403 26833 mini_postgres.cc:96] Postgres bound to 37223
2026-08-07 22:39:36.338 UTC [7096] FATAL: database "slave" does not exist
127.26.52.84:37223 - accepting connections
I20260807 22:39:36.339412 26833 mini_ranger.cc:161] Starting Ranger...
I20260807 22:39:36.354949 26833 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 22:39:36.837921 26833 mini_ranger.cc:87] Created ranger Postgres database
I20260807 22:39:36.838021 26833 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-admin
2026-08-07 22:39:37,100 [I] DB FLAVOR :POSTGRES
2026-08-07 22:39:37,100 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:39:37,100 [I] Checking connection..
2026-08-07 22:39:37,100 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 22:39:37,365 [I] Checking connection passed.
2026-08-07 22:39:37,365 [I] --------- Verifying version history table ---------
2026-08-07 22:39:37,366 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:39:37,630 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:39:37,631 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:39:37,895 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:39:37,895 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 22:39:37,895 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 22:39:38.127 UTC [7163] WARNING: there is no transaction in progress
2026-08-07 22:39:38,134 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 22:39:38,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:39:38,401 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 22:39:38,401 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:39:38,401 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 22:39:38,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 22:39:38,930 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8w9v.c.gcp-upstream.internal','N') ;"
2026-08-07 22:39:39,188 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:39:39,454 [I] Table x_portal_user does not exist in database ranger
2026-08-07 22:39:39,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:39:39,718 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 22:39:39,718 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:39:39,983 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:39:40,238 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 22:39:40,238 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 22:39:41.192 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.208 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.224 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.239 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.255 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.271 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.325 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.332 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.345 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.355 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.366 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.380 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.390 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.396 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.403 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:41.410 UTC [7280] WARNING: there is no transaction in progress
2026-08-07 22:39:42,023 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 22:39:42,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 22:39:42,274 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 22:39:42,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:39:42,535 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 22:39:42,535 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:39:42,796 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 22:39:42,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:39:43,068 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:39:43,322 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8w9v.c.gcp-upstream.internal';"
2026-08-07 22:39:43,585 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 22:39:43,585 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 22:39:43,847 [I] DB_PATCHES have already been applied
I20260807 22:39:43.852859 26833 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-admin:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskDuvoCt/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 22:39:43.852931 26833 mini_ranger.cc:193] Using host: 127.26.52.84
I20260807 22:39:43.856949 26833 mini_ranger.cc:227] Ranger admin URL: http://127.26.52.84:48563
Aug 07, 2026 10:39:44 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:39:44 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:39:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 10:39:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 10:39:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 10:39:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 10:39:44 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 22:39:45.043480 26833 mini_ranger.cc:160] Time spent starting Ranger: real 8.704s user 0.002s sys 0.009s
Aug 07, 2026 10:40:06 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 10:40:06 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 07, 2026 10:40:06 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 10:40:06 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 10:40:07 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 22:40:08.552915 26833 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.52.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.52.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/rangerkms_127.26.52.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.52.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/rangerkms_127.26.52.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.52.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.52.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.52.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/HTTP_127.26.52.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.52.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/HTTP_127.26.52.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 22:40:08 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142408, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 22:40:08.656344 26833 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 22:40:08.668366 26833 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 22:40:09.727551 26833 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 22:40:09.727648 26833 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-kms
I20260807 22:40:09.727669 26833 mini_ranger_kms.cc:227] Using postgres at 127.26.52.84:37223
2026-08-07 22:40:09,927 [I] DB FLAVOR :POSTGRES
2026-08-07 22:40:09,927 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:40:09,928 [I] Checking connection
2026-08-07 22:40:09,928 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 22:40:10,199 [I] connection success
2026-08-07 22:40:10,199 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 22:40:10,199 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 22:40:10,200 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 22:40:10,503 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 22:40:10,503 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:40:10,503 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 22:40:10,503 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.52.84:37223/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 22:40:10,815 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 22:40:11.361436 26833 mini_ranger_kms.cc:310] Created kms service
I20260807 22:40:11.557814 26833 mini_ranger_kms.cc:326] Created kudu user
I20260807 22:40:11.608217 26833 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 22:40:11 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142408, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:12.008186 26833 mini_ranger_kms.cc:384] Added ranger policy
I20260807 22:40:12.008495 26833 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-kms:/tmp/dist-test-taskDuvoCt/build/debug/bin/postgresql.jar:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskDuvoCt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 22:40:12.008528 26833 mini_ranger_kms.cc:240] Using host: 127.26.52.84
I20260807 22:40:12.013931 26833 mini_ranger_kms.cc:276] Ranger KMS PID: 7475
I20260807 22:40:12.014042 26833 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.52.84:41249
Aug 07, 2026 10:40:13 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:40:13 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:40:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 10:40:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 10:40:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 10:40:13 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260807 22:40:14.460863 26833 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.805s user 0.021s sys 0.162s
I20260807 22:40:14.461017 26833 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 22:40:14.461117 26833 mini_ranger_kms.cc:401] 127.26.52.84:41249/kms/v1/keys
Aug 07 22:40:14 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142414, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.52.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 22:40:15 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142414, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.52.84@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
Aug 07 22:40:15 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142414, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.52.84@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
Aug 07 22:40:17 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:40:17.801683 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:41465
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:37119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:41465
--ranger_config_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:41249/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:17.927992 7532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:17.928359 7532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:17.928402 7532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:17.932902 7532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:17.932987 7532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:17.933007 7532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:17.933024 7532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:17.933040 7532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:17.939465 7532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:37119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.52.84:41249/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:41465
--ranger_config_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:41465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:17.940831 7532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:17.941963 7532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:17.951696 7538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:17.951754 7540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:17.951843 7532 server_base.cc:1034] running on GCE node
W20260807 22:40:17.951782 7537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:17.952672 7532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:17.954032 7532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:17.955209 7532 hybrid_clock.cc:648] HybridClock initialized: now 1786142417955182 us; error 43 us; skew 500 ppm
Aug 07 22:40:17 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142417, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:17.968230 7532 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:40:17.969274 7532 webserver.cc:460] Webserver started at http://127.26.52.126:44311/ using document root <none> and password file <none>
I20260807 22:40:17.969911 7532 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:17.970001 7532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:17.970245 7532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:40:17 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142417, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:18.029485 7532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206"
format_stamp: "Formatted at 2026-08-07 22:40:18 on dist-test-slave-8w9v"
server_key: "b1dfd9f947147facd880149989d35616"
server_key_iv: "bbe5bfe607be67d3b28ce812f9938799"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:18.030108 7532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206"
format_stamp: "Formatted at 2026-08-07 22:40:18 on dist-test-slave-8w9v"
server_key: "b1dfd9f947147facd880149989d35616"
server_key_iv: "bbe5bfe607be67d3b28ce812f9938799"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:18.034543 7532 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:40:18.050176 7547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:18.051712 7532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:18.051900 7532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206"
format_stamp: "Formatted at 2026-08-07 22:40:18 on dist-test-slave-8w9v"
server_key: "b1dfd9f947147facd880149989d35616"
server_key_iv: "bbe5bfe607be67d3b28ce812f9938799"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:18.052057 7532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:18.071710 7532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:18.074900 7532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:18.075145 7532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:18.083086 7532 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:41465
I20260807 22:40:18.083110 7600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:41465 every 8 connection(s)
I20260807 22:40:18.084224 7532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:18.087512 7601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:18.091724 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 7532
I20260807 22:40:18.091838 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:40:18.092216 26833 external_mini_cluster.cc:1428] Setting key 9bf5f3d36d3e5586f2aa3eb3a3f97c3c
I20260807 22:40:18.094163 7601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: Bootstrap starting.
I20260807 22:40:18.096702 7601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:18.097551 7601 log.cc:824] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:18.099673 7601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: No bootstrap required, opened a new log
Aug 07 22:40:18 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:18.103933 7601 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } }
I20260807 22:40:18.104300 7601 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:18.104408 7601 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8323a0bc39d4a7ba5c3ce3de5af6206, State: Initialized, Role: FOLLOWER
I20260807 22:40:18.105058 7601 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } }
I20260807 22:40:18.105232 7601 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:18.105311 7601 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:18.105419 7601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:18.106564 7601 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } }
I20260807 22:40:18.106954 7601 leader_election.cc:302] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8323a0bc39d4a7ba5c3ce3de5af6206; no voters:
I20260807 22:40:18.107302 7601 leader_election.cc:288] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:18.107447 7606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:18.107478 7604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:18.093927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40442 (local address 127.26.52.126:41465)
0807 22:40:18.094455 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:18.094471 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:18.094509 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:40:18.095169 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:18.095186 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:18.095532 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:18.095877 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:18.096789 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:18.097885 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:18.098779 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:18.099255 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:18.099474 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:18.102141 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:18.102147 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:18.102164 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:18.102196 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:18.104039 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:18.104646 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:18.104660 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:18.104665 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:18.104780 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:18.105093 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:18.105099 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:18.105105 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:18.105686 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:18.105901 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:18.106228 (+ 327us) server_negotiation.cc:299] Negotiation successful
0807 22:40:18.106535 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":159,"threads_started":1}
I20260807 22:40:18.107694 7606 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 1 LEADER]: Becoming Leader. State: Replica: d8323a0bc39d4a7ba5c3ce3de5af6206, State: Running, Role: LEADER
I20260807 22:40:18.108052 7606 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } }
I20260807 22:40:18.108800 7601 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:18.109961 7608 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8323a0bc39d4a7ba5c3ce3de5af6206. Latest consensus state: current_term: 1 leader_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } } }
I20260807 22:40:18.109961 7607 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } } }
I20260807 22:40:18.110114 7607 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:18.110114 7608 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:18.110574 7616 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:18.114029 7616 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:18.114446 7601 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 22:40:18.125891 7616 catalog_manager.cc:1347] Generated new cluster ID: 060a07b19c954287b2b9a06288f9d99e
I20260807 22:40:18.125993 7616 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:18.135579 7616 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:18.136744 7616 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:18.142244 7616 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: Generated new TSK 0
I20260807 22:40:18.143004 7616 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:40:18.883592 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:41249/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41465
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:37119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:19.011466 7652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:19.011765 7652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:19.011878 7652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:19.016542 7652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:19.016623 7652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:19.016724 7652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:40:19.022913 7652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:37119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.52.84:41249/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:19.024165 7652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:19.025254 7652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:40:19.036899 7652 server_base.cc:1034] running on GCE node
W20260807 22:40:19.036721 7661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:19.036695 7663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:19.036721 7660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:19.037703 7652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:19.038372 7652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:19.039587 7652 hybrid_clock.cc:648] HybridClock initialized: now 1786142419039552 us; error 52 us; skew 500 ppm
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:19.042766 7652 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:40:19.043740 7652 webserver.cc:460] Webserver started at http://127.26.52.65:36077/ using document root <none> and password file <none>
I20260807 22:40:19.044428 7652 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:19.044517 7652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:19.044814 7652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:19.061877 7652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "77ac84a5a2a046d1b31dba3ad5f59b27"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "6cfb0d336bcc47c6931169faebb58849"
server_key_iv: "5da4201db810471163f6c9d2c97e155a"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:19.064555 7652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "77ac84a5a2a046d1b31dba3ad5f59b27"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "6cfb0d336bcc47c6931169faebb58849"
server_key_iv: "5da4201db810471163f6c9d2c97e155a"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:19.073491 7652 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.001s
I20260807 22:40:19.092990 7672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:19.094890 7652 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260807 22:40:19.095033 7652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "77ac84a5a2a046d1b31dba3ad5f59b27"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "6cfb0d336bcc47c6931169faebb58849"
server_key_iv: "5da4201db810471163f6c9d2c97e155a"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:19.095175 7652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:19.119531 7652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:19.123335 7652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:19.123538 7652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:19.124271 7652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:19.125347 7652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:19.125451 7652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:19.125595 7652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:19.125636 7652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:19.139750 7652 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:45951
I20260807 22:40:19.141134 7652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:19.143781 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 7652
I20260807 22:40:19.143939 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:19.144418 26833 external_mini_cluster.cc:1428] Setting key 46d1271941e66decb93b43d0c19fa263
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:40:19.143504 7792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:45951 every 8 connection(s)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:40:19.162415 7796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:19.144174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41465 (local address 127.26.52.65:43005)
0807 22:40:19.145535 (+ 1361us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:19.145593 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:19.146705 (+ 1112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:19.147499 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:19.147509 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:19.147864 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:19.148567 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:19.148586 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.150116 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.150120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:19.151578 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:19.151591 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.152498 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.152503 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:19.152715 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:19.153496 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:19.153521 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:19.155565 (+ 2044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:19.158385 (+ 2820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:19.158393 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:19.158412 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:19.158808 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:19.159195 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:19.159199 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:19.159201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:19.159426 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:19.160020 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:19.160028 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:19.160525 (+ 497us) client_negotiation.cc:769] Sending connection context
0807 22:40:19.160793 (+ 268us) client_negotiation.cc:240] Negotiation successful
0807 22:40:19.161202 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1130,"thread_start_us":137,"threads_started":1}
I20260807 22:40:19.162773 7797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:19.144351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:43005 (local address 127.26.52.126:41465)
0807 22:40:19.145245 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:19.145250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:19.145684 (+ 434us) server_negotiation.cc:407] Connection header received
0807 22:40:19.146953 (+ 1269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:19.146957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:19.147015 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:19.147082 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:19.148758 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.149932 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.151751 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.152169 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.152295 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:19.155808 (+ 3513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:19.155813 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:19.155816 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:19.155849 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:19.158166 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:19.158948 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:19.158953 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:19.158955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:19.159071 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:19.159564 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:19.159569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:19.159571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:19.159843 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:19.159955 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:19.162380 (+ 2425us) server_negotiation.cc:299] Negotiation successful
0807 22:40:19.162560 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":86,"threads_started":1}
I20260807 22:40:19.164435 7793 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41465
I20260807 22:40:19.164721 7793 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:19.165365 7793 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
I20260807 22:40:19.167363 7564 ts_manager.cc:194] Registered new tserver with Master: 77ac84a5a2a046d1b31dba3ad5f59b27 (127.26.52.65:45951)
I20260807 22:40:19.169083 7564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:43005
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:40:19.188643 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:41249/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41465
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:37119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 22:40:19.326828 7803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:19.327188 7803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:19.327314 7803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:19.332487 7803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:19.332643 7803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:19.332755 7803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:40:19.339761 7803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:37119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.52.84:41249/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:19.341039 7803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:19.342470 7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:19.354974 7812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:19.355098 7810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:19.354967 7809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:19.356449 7803 server_base.cc:1034] running on GCE node
I20260807 22:40:19.356977 7803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:19.357765 7803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:19.358981 7803 hybrid_clock.cc:648] HybridClock initialized: now 1786142419358946 us; error 51 us; skew 500 ppm
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:19.361989 7803 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:40:19.362942 7803 webserver.cc:460] Webserver started at http://127.26.52.66:33705/ using document root <none> and password file <none>
I20260807 22:40:19.363555 7803 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:19.363646 7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:19.363919 7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:19.382300 7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "362d80c0cf9f40039abea4b5c2ff94c6"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "bb8779da8317d251cc36a7525a38c0d3"
server_key_iv: "23d84d78ba05811f43d03fd1fa0a8e34"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:19.383136 7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "362d80c0cf9f40039abea4b5c2ff94c6"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "bb8779da8317d251cc36a7525a38c0d3"
server_key_iv: "23d84d78ba05811f43d03fd1fa0a8e34"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:19.389379 7803 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 22:40:19.412847 7819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:19.414973 7803 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260807 22:40:19.415139 7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "362d80c0cf9f40039abea4b5c2ff94c6"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "bb8779da8317d251cc36a7525a38c0d3"
server_key_iv: "23d84d78ba05811f43d03fd1fa0a8e34"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:19.415298 7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:19.452015 7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:19.456458 7803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:19.456800 7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:19.457583 7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:19.458748 7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:19.458866 7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:19.458973 7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:19.459043 7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:19.474139 7803 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:38553
I20260807 22:40:19.475450 7803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:19.484318 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 7803
I20260807 22:40:19.484498 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:19.484858 26833 external_mini_cluster.cc:1428] Setting key 91ad53f0a93df87be61c8d787012eaf9
I20260807 22:40:19.477088 7942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:38553 every 8 connection(s)
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:19.500581 7797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:19.481051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:33007 (local address 127.26.52.126:41465)
0807 22:40:19.481219 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:19.481225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:19.481698 (+ 473us) server_negotiation.cc:407] Connection header received
0807 22:40:19.483003 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:19.483007 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:19.483068 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:19.483121 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:19.485107 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.485972 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.491914 (+ 5942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.492304 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.492395 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:19.495856 (+ 3461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:19.495860 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:19.495863 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:19.495895 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:19.497796 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:19.498516 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:19.498520 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:19.498522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:19.498617 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:19.499066 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:19.499069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:19.499071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:19.499312 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:19.499403 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:19.500212 (+ 809us) server_negotiation.cc:299] Negotiation successful
0807 22:40:19.500366 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:40:19.502951 7945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:19.479824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41465 (local address 127.26.52.66:33007)
0807 22:40:19.481516 (+ 1692us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:19.481577 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:19.482727 (+ 1150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:19.483556 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:19.483567 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:19.483946 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:19.484848 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:19.484869 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.490094 (+ 5225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.490098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:19.491731 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:19.491747 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.492654 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.492659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:19.492951 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:19.493761 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:19.493786 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:19.495618 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:19.497964 (+ 2346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:19.497970 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:19.497991 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:19.498369 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:19.498731 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:19.498734 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:19.498736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:19.498947 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:19.499499 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:19.499507 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:19.499871 (+ 364us) client_negotiation.cc:769] Sending connection context
0807 22:40:19.501171 (+ 1300us) client_negotiation.cc:240] Negotiation successful
0807 22:40:19.501575 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1435,"thread_start_us":177,"threads_started":1}
I20260807 22:40:19.504720 7943 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41465
I20260807 22:40:19.504984 7943 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:19.505614 7943 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
I20260807 22:40:19.507006 7564 ts_manager.cc:194] Registered new tserver with Master: 362d80c0cf9f40039abea4b5c2ff94c6 (127.26.52.66:38553)
I20260807 22:40:19.508040 7564 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:33007
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:40:19.552349 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:41249/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41465
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:37119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:19.752064 7948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:19.755519 7948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:19.755653 7948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:19.762537 7948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:19.762722 7948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:19.763010 7948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:40:19.771750 7948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:37119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.52.84:41249/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:19.773713 7948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:19.775678 7948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:19.793664 7954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:19.794034 7948 server_base.cc:1034] running on GCE node
W20260807 22:40:19.794605 7953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:19.796041 7956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:19.796777 7948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:19.797645 7948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:19.808998 7948 hybrid_clock.cc:648] HybridClock initialized: now 1786142419808869 us; error 119 us; skew 500 ppm
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:19.816680 7948 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:40:19.818041 7948 webserver.cc:460] Webserver started at http://127.26.52.67:38801/ using document root <none> and password file <none>
I20260807 22:40:19.821652 7948 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:19.821843 7948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:19.822168 7948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:19.874217 7948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "858c50c47da64d7db1bb325ca21e2350"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "2e86045c799bd3aca0091bde0bff8dbd"
server_key_iv: "24802c83907fdf0ddcc028ba90297429"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:19.875137 7948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "858c50c47da64d7db1bb325ca21e2350"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "2e86045c799bd3aca0091bde0bff8dbd"
server_key_iv: "24802c83907fdf0ddcc028ba90297429"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:19.892172 7948 fs_manager.cc:691] Time spent creating directory manager: real 0.017s user 0.005s sys 0.000s
I20260807 22:40:19.924566 7963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:19.926530 7948 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260807 22:40:19.926678 7948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "858c50c47da64d7db1bb325ca21e2350"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "2e86045c799bd3aca0091bde0bff8dbd"
server_key_iv: "24802c83907fdf0ddcc028ba90297429"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:19.926824 7948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:19.942018 7948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:19.945962 7948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:19.946239 7948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:19.946986 7948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:19.948159 7948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:19.948266 7948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:19.948370 7948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:19.948436 7948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:19.972591 7948 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:40327
I20260807 22:40:19.973872 7948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:19.975968 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 7948
I20260807 22:40:19.976158 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:19.976486 26833 external_mini_cluster.cc:1428] Setting key 04ac2e7653b1f9868a2331f421d5a797
I20260807 22:40:19.978268 8083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:40327 every 8 connection(s)
Aug 07 22:40:19 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:19.997251 7797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:19.982168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:57909 (local address 127.26.52.126:41465)
0807 22:40:19.982296 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:19.982301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:19.982810 (+ 509us) server_negotiation.cc:407] Connection header received
0807 22:40:19.984076 (+ 1266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:19.984079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:19.984160 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:19.984213 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:19.985886 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.986725 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.988499 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.988847 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.988919 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:19.992335 (+ 3416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:19.992339 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:19.992342 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:19.992371 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:19.994692 (+ 2321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:19.995316 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:19.995320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:19.995322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:19.995410 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:19.995803 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:19.995806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:19.995808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:19.996053 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:19.996160 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:19.996955 (+ 795us) server_negotiation.cc:299] Negotiation successful
0807 22:40:19.997085 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:40:19.999094 8086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:19.981017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41465 (local address 127.26.52.67:57909)
0807 22:40:19.982649 (+ 1632us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:19.982710 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:19.983806 (+ 1096us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:19.984642 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:19.984652 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:19.985054 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:19.985716 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:19.985734 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.986889 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.986892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:19.988357 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:19.988367 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:19.989144 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:19.989147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:19.989344 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:19.990310 (+ 966us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:19.990332 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:19.992145 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:19.994825 (+ 2680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:19.994832 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:19.994849 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:19.995197 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:19.995522 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:19.995525 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:19.995527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:19.995698 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:19.996321 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:19.996328 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:19.996652 (+ 324us) client_negotiation.cc:769] Sending connection context
0807 22:40:19.997663 (+ 1011us) client_negotiation.cc:240] Negotiation successful
0807 22:40:19.998031 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1398,"thread_start_us":177,"threads_started":1}
I20260807 22:40:20.000667 8084 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41465
I20260807 22:40:20.000938 8084 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:20.001554 8084 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
I20260807 22:40:20.002776 7562 ts_manager.cc:194] Registered new tserver with Master: 858c50c47da64d7db1bb325ca21e2350 (127.26.52.67:40327)
I20260807 22:40:20.003506 7562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:57909
I20260807 22:40:20.015969 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:40:20.016814 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 7652
I20260807 22:40:20.033571 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 7803
I20260807 22:40:20.046290 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 7948
I20260807 22:40:20.058173 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 7532
I20260807 22:40:20.070528 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:41465
--webserver_interface=127.26.52.126
--webserver_port=44311
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:37119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:41465
--ranger_config_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:41249/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.52.84:41249/kms with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:20.189913 8087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:20.190335 8087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:20.190443 8087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:20.194581 8087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:20.194657 8087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:20.194676 8087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:20.194693 8087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:20.194710 8087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:20.200677 8087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:37119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.52.84:41249/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:41465
--ranger_config_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:41465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=44311
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:20.201905 8087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:20.203001 8087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:20.212507 8093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.212488 8095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.212488 8092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:20.212945 8087 server_base.cc:1034] running on GCE node
I20260807 22:40:20.213624 8087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:20.214807 8087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:20.215988 8087 hybrid_clock.cc:648] HybridClock initialized: now 1786142420215974 us; error 31 us; skew 500 ppm
Aug 07 22:40:20 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:20.218869 8087 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:40:20.219817 8087 webserver.cc:460] Webserver started at http://127.26.52.126:44311/ using document root <none> and password file <none>
I20260807 22:40:20.220480 8087 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:20.220582 8087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:40:20 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:20.266655 8087 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:40:20.269352 8104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.270774 8087 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:20.270939 8087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206"
format_stamp: "Formatted at 2026-08-07 22:40:18 on dist-test-slave-8w9v"
server_key: "b1dfd9f947147facd880149989d35616"
server_key_iv: "bbe5bfe607be67d3b28ce812f9938799"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:20.271564 8087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:20.290562 8087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:20.293738 8087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:20.293987 8087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:20.301973 8087 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:41465
I20260807 22:40:20.301993 8162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:41465 every 8 connection(s)
I20260807 22:40:20.303238 8087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:20.307983 8163 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:40:20.309329 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 8087
I20260807 22:40:20.309808 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:41249/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:45951
--local_ip_for_outbound_sockets=127.26.52.65
--tserver_master_addrs=127.26.52.126:41465
--webserver_port=36077
--webserver_interface=127.26.52.65
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:37119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.52.84:41249/kms with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:40:20.309957 8163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: Bootstrap starting.
I20260807 22:40:20.327154 8163 log.cc:824] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:20.334431 8163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:40:20.334897 8163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: Bootstrap complete.
I20260807 22:40:20.339367 8163 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } }
I20260807 22:40:20.339778 8163 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8323a0bc39d4a7ba5c3ce3de5af6206, State: Initialized, Role: FOLLOWER
I20260807 22:40:20.340344 8163 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } }
I20260807 22:40:20.340466 8163 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:20.340549 8163 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:20.340647 8163 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:40:20.342695 8163 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } }
I20260807 22:40:20.343052 8163 leader_election.cc:302] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8323a0bc39d4a7ba5c3ce3de5af6206; no voters:
I20260807 22:40:20.343411 8163 leader_election.cc:288] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:40:20.343533 8167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:40:20.343770 8167 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [term 2 LEADER]: Becoming Leader. State: Replica: d8323a0bc39d4a7ba5c3ce3de5af6206, State: Running, Role: LEADER
I20260807 22:40:20.344199 8167 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } }
I20260807 22:40:20.344803 8163 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:20.345721 8168 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } } }
I20260807 22:40:20.345880 8168 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:20.346262 8169 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8323a0bc39d4a7ba5c3ce3de5af6206. Latest consensus state: current_term: 2 leader_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8323a0bc39d4a7ba5c3ce3de5af6206" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41465 } } }
I20260807 22:40:20.346407 8169 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:20.346743 8176 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:20.347388 8163 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 22:40:20.353269 8176 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:20.354132 8176 catalog_manager.cc:1259] Loaded cluster ID: 060a07b19c954287b2b9a06288f9d99e
I20260807 22:40:20.354238 8176 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:20.357036 8176 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:20.357836 8176 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: Loaded TSK: 0
I20260807 22:40:20.359475 8176 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:40:20.447357 8165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:20.447769 8165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:20.447889 8165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:20.454800 8165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:20.454912 8165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:20.455015 8165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:40:20.463805 8165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:37119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.52.84:41249/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:45951
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=36077
--tserver_master_addrs=127.26.52.126:41465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:20.465603 8165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:20.467161 8165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:20.478603 8201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:20.478907 8165 server_base.cc:1034] running on GCE node
W20260807 22:40:20.479264 8203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.479513 8200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:20.480175 8165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:20.481102 8165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:20.482291 8165 hybrid_clock.cc:648] HybridClock initialized: now 1786142420482253 us; error 60 us; skew 500 ppm
Aug 07 22:40:20 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:20.485471 8165 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:40:20.486639 8165 webserver.cc:460] Webserver started at http://127.26.52.65:36077/ using document root <none> and password file <none>
I20260807 22:40:20.487274 8165 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:20.487448 8165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:40:20 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:20.515599 8165 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:40:20.519251 8212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.521034 8165 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260807 22:40:20.521198 8165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "77ac84a5a2a046d1b31dba3ad5f59b27"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "6cfb0d336bcc47c6931169faebb58849"
server_key_iv: "5da4201db810471163f6c9d2c97e155a"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:20.521971 8165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:20.541752 8165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:20.546932 8165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:20.547232 8165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:20.548007 8165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:20.549314 8165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:20.549448 8165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.549616 8165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:20.549716 8165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.563951 8165 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:45951
I20260807 22:40:20.565456 8165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:20.566636 8333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:45951 every 8 connection(s)
I20260807 22:40:20.569001 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 8165
I20260807 22:40:20.569542 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:41249/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:38553
--local_ip_for_outbound_sockets=127.26.52.66
--tserver_master_addrs=127.26.52.126:41465
--webserver_port=33705
--webserver_interface=127.26.52.66
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:37119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.52.84:41249/kms with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:40:20 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:20.597151 8337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.569067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41465 (local address 127.26.52.65:37977)
0807 22:40:20.569728 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:20.569782 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:20.570688 (+ 906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:20.572566 (+ 1878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:20.572580 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:20.573161 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:20.573874 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:20.573900 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.575980 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.575987 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:20.577677 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:20.577694 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.584517 (+ 6823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.584524 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:20.584831 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.588001 (+ 3170us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:20.588032 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:20.589816 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:20.592874 (+ 3058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:20.592883 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:20.592901 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:20.593339 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:20.593854 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:20.593861 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:20.593863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:20.594079 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:20.594955 (+ 876us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:20.594962 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:20.595324 (+ 362us) client_negotiation.cc:769] Sending connection context
0807 22:40:20.595542 (+ 218us) client_negotiation.cc:240] Negotiation successful
0807 22:40:20.595927 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":128,"threads_started":1}
I20260807 22:40:20.599879 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.568958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:37977 (local address 127.26.52.126:41465)
0807 22:40:20.571124 (+ 2166us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:20.571141 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:20.571175 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:40:20.571518 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:20.571535 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:20.571969 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:20.572352 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:20.574091 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.575735 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.577904 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.578770 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.579007 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.590111 (+ 11104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:20.590121 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:20.590144 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:20.590183 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:20.592673 (+ 2490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.593537 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.593544 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.593551 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.593718 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.594219 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.594222 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.594223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.594804 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:20.598325 (+ 3521us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:20.598506 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 22:40:20.598848 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2014,"thread_start_us":142,"threads_started":1}
I20260807 22:40:20.603051 8334 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41465
I20260807 22:40:20.603351 8334 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:20.603997 8334 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
W20260807 22:40:20.606707 8334 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:41465 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 22:40:20.606855 8334 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:20.607072 8334 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
I20260807 22:40:20.608247 8334 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:20.608486 8334 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
W20260807 22:40:20.609375 8334 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:40:20.730885 8338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:20.731323 8338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:20.731448 8338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:20.737386 8338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:20.737548 8338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:20.737658 8338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:40:20.745687 8338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:37119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.52.84:41249/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:38553
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=33705
--tserver_master_addrs=127.26.52.126:41465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:20.747026 8338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:20.748386 8338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:20.760526 8345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.760845 8347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.760524 8344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:20.761878 8338 server_base.cc:1034] running on GCE node
I20260807 22:40:20.762423 8338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:20.763302 8338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:20.764559 8338 hybrid_clock.cc:648] HybridClock initialized: now 1786142420764530 us; error 46 us; skew 500 ppm
Aug 07 22:40:20 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:20.767675 8338 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:40:20.768824 8338 webserver.cc:460] Webserver started at http://127.26.52.66:33705/ using document root <none> and password file <none>
I20260807 22:40:20.769454 8338 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:20.769563 8338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:40:20 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:20.801064 8338 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:40:20.804663 8355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.806551 8338 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 22:40:20.806712 8338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "362d80c0cf9f40039abea4b5c2ff94c6"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "bb8779da8317d251cc36a7525a38c0d3"
server_key_iv: "23d84d78ba05811f43d03fd1fa0a8e34"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:20.807490 8338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:20.831822 8338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:20.835256 8338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:20.835496 8338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:20.836193 8338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:20.837162 8338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:20.837231 8338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.837311 8338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:20.837352 8338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.850050 8338 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:38553
I20260807 22:40:20.850107 8477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:38553 every 8 connection(s)
I20260807 22:40:20.851508 8338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:20.861843 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 8338
I20260807 22:40:20.862438 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.52.84:41249/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:40327
--local_ip_for_outbound_sockets=127.26.52.67
--tserver_master_addrs=127.26.52.126:41465
--webserver_port=38801
--webserver_interface=127.26.52.67
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:37119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.52.84:41249/kms with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:40:20 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:20.872298 8480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.854361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41465 (local address 127.26.52.66:37479)
0807 22:40:20.856505 (+ 2144us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:20.856571 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:20.857841 (+ 1270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:20.858545 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:20.858555 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:20.858939 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:20.859647 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:20.859667 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.860913 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.860918 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:20.862426 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:20.862439 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.863284 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.863288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:20.863507 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.864227 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:20.864249 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:20.866106 (+ 1857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:20.868447 (+ 2341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:20.868454 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:20.868475 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:20.868899 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:20.869265 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:20.869271 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:20.869273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:20.869485 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:20.870042 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:20.870051 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:20.870428 (+ 377us) client_negotiation.cc:769] Sending connection context
0807 22:40:20.870653 (+ 225us) client_negotiation.cc:240] Negotiation successful
0807 22:40:20.871042 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1886,"thread_start_us":149,"threads_started":1}
I20260807 22:40:20.873143 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.855579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:37479 (local address 127.26.52.126:41465)
0807 22:40:20.855729 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:20.855734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:20.856719 (+ 985us) server_negotiation.cc:407] Connection header received
0807 22:40:20.858130 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:20.858135 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:20.858205 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:20.858329 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:20.859839 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.860740 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.862587 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.862953 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.863036 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.866334 (+ 3298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:20.866339 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:20.866343 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:20.866374 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:20.868285 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.869035 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.869039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.869041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.869141 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.869604 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.869607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.869609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.869857 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:20.869978 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:20.872808 (+ 2830us) server_negotiation.cc:299] Negotiation successful
0807 22:40:20.872988 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:40:20.874428 8478 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41465
I20260807 22:40:20.874722 8478 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:20.875483 8478 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
W20260807 22:40:20.877490 8478 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:41465 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 22:40:20.877641 8478 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:20.877933 8478 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
I20260807 22:40:20.878980 8478 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:20.879235 8478 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
W20260807 22:40:20.880191 8478 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:40:21.042935 8481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:21.043341 8481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:21.043411 8481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:21.050022 8481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:21.050206 8481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:21.050345 8481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:40:21.058709 8481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:37119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.52.84:41249/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:40327
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=38801
--tserver_master_addrs=127.26.52.126:41465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:21.060240 8481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:21.061648 8481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:21.072413 8489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:21.072515 8481 server_base.cc:1034] running on GCE node
W20260807 22:40:21.072413 8488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:21.072772 8491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:21.073278 8481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:21.074090 8481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:21.075266 8481 hybrid_clock.cc:648] HybridClock initialized: now 1786142421075232 us; error 50 us; skew 500 ppm
Aug 07 22:40:21 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142421, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:21.078431 8481 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:40:21.079480 8481 webserver.cc:460] Webserver started at http://127.26.52.67:38801/ using document root <none> and password file <none>
I20260807 22:40:21.080190 8481 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:21.080305 8481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:40:21 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142421, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:21.107017 8481 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:40:21.110347 8500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:21.111878 8481 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:21.112040 8481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "858c50c47da64d7db1bb325ca21e2350"
format_stamp: "Formatted at 2026-08-07 22:40:19 on dist-test-slave-8w9v"
server_key: "2e86045c799bd3aca0091bde0bff8dbd"
server_key_iv: "24802c83907fdf0ddcc028ba90297429"
server_key_version: "kuduclusterkey@0"
I20260807 22:40:21.112936 8481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:21.148324 8481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:21.151893 8481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:21.152165 8481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:21.152981 8481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:21.154137 8481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:21.154209 8481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:21.154274 8481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:21.154309 8481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:21.166742 8481 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:40327
I20260807 22:40:21.166762 8622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:40327 every 8 connection(s)
I20260807 22:40:21.168203 8481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:21.174043 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 8481
Aug 07 22:40:21 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142421, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:21.186105 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:21.171226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:44563 (local address 127.26.52.126:41465)
0807 22:40:21.171376 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:21.171381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:21.172527 (+ 1146us) server_negotiation.cc:407] Connection header received
0807 22:40:21.173548 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:21.173553 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:21.173617 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:21.173721 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:21.175400 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.176285 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.178039 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.178388 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.178485 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:21.181686 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:21.181690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:21.181693 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:21.181719 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:21.183553 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:21.184283 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:21.184289 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:21.184294 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:21.184375 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:21.184829 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:21.184834 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:21.184835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:21.185089 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:21.185194 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:21.185799 (+ 605us) server_negotiation.cc:299] Negotiation successful
0807 22:40:21.185931 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 22:40:21.187114 8625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:21.171739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41465 (local address 127.26.52.67:44563)
0807 22:40:21.172325 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:21.172381 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:21.173315 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:21.174072 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:21.174084 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:21.174492 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:21.175201 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:21.175223 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.176478 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.176482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:21.177887 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:21.177899 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.178713 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.178717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:21.178926 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:21.179621 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:21.179643 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:21.181481 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:21.183699 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:21.183706 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:21.183726 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:21.184155 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:21.184477 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:21.184482 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:21.184484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:21.184700 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:21.185195 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:21.185204 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:21.185547 (+ 343us) client_negotiation.cc:769] Sending connection context
0807 22:40:21.185742 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 22:40:21.186096 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":163,"threads_started":1}
I20260807 22:40:21.188694 8623 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41465
I20260807 22:40:21.188797 8629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:21.174813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40450 (local address 127.26.52.126:41465)
0807 22:40:21.175093 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:21.175098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:21.176472 (+ 1374us) server_negotiation.cc:407] Connection header received
0807 22:40:21.176755 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:21.176759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:21.176814 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:21.176881 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:21.177738 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.178265 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.179651 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.179945 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.180040 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:21.182503 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:21.182506 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:21.182509 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:21.182554 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:21.184254 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:21.185230 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:21.185233 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:21.185234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:21.185310 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:21.187859 (+ 2549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:21.187862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:21.187863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:21.188045 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:21.188286 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:21.188480 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 22:40:21.188607 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":102,"threads_started":1}
I20260807 22:40:21.188979 8623 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:21.189600 8623 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
I20260807 22:40:21.191123 8123 ts_manager.cc:194] Registered new tserver with Master: 858c50c47da64d7db1bb325ca21e2350 (127.26.52.67:40327)
I20260807 22:40:21.192377 8123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:44563
Aug 07 22:40:21 dist-test-slave-8w9v krb5kdc[7052](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142421, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:21.609612 8334 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:21.609941 8334 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
I20260807 22:40:21.610803 8123 ts_manager.cc:194] Registered new tserver with Master: 77ac84a5a2a046d1b31dba3ad5f59b27 (127.26.52.65:45951)
I20260807 22:40:21.611634 8123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:37977
I20260807 22:40:21.880514 8478 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:21.880877 8478 heartbeater.cc:511] Master 127.26.52.126:41465 requested a full tablet report, sending...
I20260807 22:40:21.881917 8123 ts_manager.cc:194] Registered new tserver with Master: 362d80c0cf9f40039abea4b5c2ff94c6 (127.26.52.66:38553)
I20260807 22:40:21.882720 8123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:37479
I20260807 22:40:21.883033 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:40:21.896019 8646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:21.885532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40458 (local address 127.26.52.126:41465)
0807 22:40:21.887145 (+ 1613us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:21.887149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:21.887164 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:40:21.887202 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:21.887205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:21.887244 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:21.887371 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:21.888114 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.888741 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.889931 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.890245 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.890367 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:21.892355 (+ 1988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:21.892359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:21.892362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:21.892399 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:21.894008 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:21.894672 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:21.894676 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:21.894677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:21.894764 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:21.895051 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:21.895055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:21.895056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:21.895256 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:21.895412 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:21.895652 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 22:40:21.895788 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1526,"thread_start_us":116,"threads_started":1}
I20260807 22:40:21.900377 8123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40458:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:21.904044 8123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:21.930117 8655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:21.922095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:38553 (local address 127.0.0.1:33026)
0807 22:40:21.924192 (+ 2097us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:21.924204 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:21.924329 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:21.924918 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:21.924925 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:21.924949 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:21.925141 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:21.925151 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.926883 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.926887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:21.928291 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:21.928303 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.929519 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.929522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:21.929638 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:21.929691 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 22:40:21.929802 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:40:21.929945 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2011,"thread_start_us":106,"threads_started":1}
I20260807 22:40:21.930828 8658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:21.922524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33026 (local address 127.26.52.66:38553)
0807 22:40:21.922845 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:21.922855 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:21.924438 (+ 1583us) server_negotiation.cc:407] Connection header received
0807 22:40:21.924511 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:21.924515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:21.924724 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:21.925312 (+ 588us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:21.925476 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.926711 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.928497 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.929374 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.930332 (+ 958us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:21.930506 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:21.930564 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 22:40:21.930669 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":121,"threads_started":1}
I20260807 22:40:21.935016 8392 tablet_service.cc:1467] Processing CreateTablet for tablet 4998f7e55b7547489724b947fa2c95b5 (DEFAULT_TABLE table=test-table [id=9c8613431d1b40e896253f1ae9211601]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:21.935603 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:21.921829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:40327 (local address 127.0.0.1:55274)
0807 22:40:21.923783 (+ 1954us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:21.923799 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:21.923946 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:21.925217 (+ 1271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:21.925223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:21.925242 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:21.925337 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:21.925343 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.931773 (+ 6430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.931778 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:21.932875 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:21.932888 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.935155 (+ 2267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.935160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:21.935265 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:21.935310 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 22:40:21.935367 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 22:40:21.935449 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1883,"thread_start_us":109,"threads_started":1}
I20260807 22:40:21.936421 8657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:21.922298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55274 (local address 127.26.52.67:40327)
0807 22:40:21.923281 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:21.923288 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:21.924340 (+ 1052us) server_negotiation.cc:407] Connection header received
0807 22:40:21.924437 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:21.924443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:21.924931 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:21.925477 (+ 546us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:21.925616 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.926707 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.934088 (+ 7381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.934985 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.935832 (+ 847us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:21.936051 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:21.936116 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 22:40:21.936265 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":854,"thread_start_us":76,"threads_started":1}
I20260807 22:40:21.937671 8392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4998f7e55b7547489724b947fa2c95b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:21.939790 8551 tablet_service.cc:1467] Processing CreateTablet for tablet 4998f7e55b7547489724b947fa2c95b5 (DEFAULT_TABLE table=test-table [id=9c8613431d1b40e896253f1ae9211601]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:21.940826 8652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:21.918987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:45951 (local address 127.0.0.1:39898)
0807 22:40:21.923564 (+ 4577us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:21.925029 (+ 1465us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:21.925100 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:21.926733 (+ 1633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:21.926738 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:21.926759 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:21.926870 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:21.926876 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.928276 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.928283 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:21.929379 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:21.929392 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.940252 (+ 10860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.940257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:21.940398 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:21.940435 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 22:40:21.940559 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 22:40:21.940651 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4377,"thread_start_us":142,"threads_started":1}
I20260807 22:40:21.941403 8654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:21.919973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39898 (local address 127.26.52.65:45951)
0807 22:40:21.926090 (+ 6117us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:21.926098 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:21.926127 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:40:21.926211 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:21.926218 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:21.926413 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:21.926564 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:21.927015 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.928063 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.929593 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:21.930431 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:21.930539 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:21.930682 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:21.941097 (+ 10415us) server_negotiation.cc:299] Negotiation successful
0807 22:40:21.941243 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5991,"thread_start_us":104,"threads_started":1}
I20260807 22:40:21.942744 8551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4998f7e55b7547489724b947fa2c95b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:21.945163 8265 tablet_service.cc:1467] Processing CreateTablet for tablet 4998f7e55b7547489724b947fa2c95b5 (DEFAULT_TABLE table=test-table [id=9c8613431d1b40e896253f1ae9211601]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:21.946638 8265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4998f7e55b7547489724b947fa2c95b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:21.955474 8660 tablet_bootstrap.cc:492] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: Bootstrap starting.
I20260807 22:40:21.958283 8660 tablet_bootstrap.cc:654] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:21.958681 8662 tablet_bootstrap.cc:492] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27: Bootstrap starting.
I20260807 22:40:21.959370 8660 log.cc:824] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:21.959569 8659 tablet_bootstrap.cc:492] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: Bootstrap starting.
I20260807 22:40:21.961516 8662 tablet_bootstrap.cc:654] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:21.961992 8660 tablet_bootstrap.cc:492] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: No bootstrap required, opened a new log
I20260807 22:40:21.962217 8660 ts_tablet_manager.cc:1397] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:40:21.962623 8662 log.cc:824] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:21.962718 8659 tablet_bootstrap.cc:654] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:21.963515 8659 log.cc:824] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:21.965858 8662 tablet_bootstrap.cc:492] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27: No bootstrap required, opened a new log
I20260807 22:40:21.966085 8662 ts_tablet_manager.cc:1397] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 22:40:21.967264 8660 raft_consensus.cc:348] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } }
I20260807 22:40:21.967571 8660 raft_consensus.cc:374] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:21.967619 8660 raft_consensus.cc:729] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858c50c47da64d7db1bb325ca21e2350, State: Initialized, Role: FOLLOWER
I20260807 22:40:21.969527 8660 consensus_queue.cc:260] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } }
I20260807 22:40:21.970206 8662 raft_consensus.cc:348] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } }
I20260807 22:40:21.970480 8662 raft_consensus.cc:374] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:21.970530 8662 raft_consensus.cc:729] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ac84a5a2a046d1b31dba3ad5f59b27, State: Initialized, Role: FOLLOWER
Aug 07 22:40:21 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142421, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:21.970695 8623 heartbeater.cc:503] Master 127.26.52.126:41465 was elected leader, sending a full tablet report...
I20260807 22:40:21.970813 8660 ts_tablet_manager.cc:1428] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: Time spent starting tablet: real 0.009s user 0.002s sys 0.007s
I20260807 22:40:21.971355 8662 consensus_queue.cc:260] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } }
I20260807 22:40:21.972581 8662 ts_tablet_manager.cc:1428] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:40:21.973008 8334 heartbeater.cc:503] Master 127.26.52.126:41465 was elected leader, sending a full tablet report...
I20260807 22:40:21.973901 8659 tablet_bootstrap.cc:492] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: No bootstrap required, opened a new log
I20260807 22:40:21.974136 8659 ts_tablet_manager.cc:1397] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260807 22:40:21.979911 8659 raft_consensus.cc:348] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } }
I20260807 22:40:21.980501 8659 raft_consensus.cc:374] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:21.980631 8659 raft_consensus.cc:729] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 362d80c0cf9f40039abea4b5c2ff94c6, State: Initialized, Role: FOLLOWER
I20260807 22:40:21.981256 8659 consensus_queue.cc:260] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } }
I20260807 22:40:21.982689 8659 ts_tablet_manager.cc:1428] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260807 22:40:21.983145 8478 heartbeater.cc:503] Master 127.26.52.126:41465 was elected leader, sending a full tablet report...
W20260807 22:40:22.077953 8335 tablet.cc:2369] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:40:22.104297 8479 tablet.cc:2369] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:40:22.170258 8624 tablet.cc:2369] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 22:40:22 dist-test-slave-8w9v krb5kdc[7052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142421, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for HTTP/127.26.52.84@KRBTEST.COM
I20260807 22:40:22.377274 8670 raft_consensus.cc:482] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:22.377573 8670 raft_consensus.cc:504] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } }
I20260807 22:40:22.379127 8670 leader_election.cc:288] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77ac84a5a2a046d1b31dba3ad5f59b27 (127.26.52.65:45951), 858c50c47da64d7db1bb325ca21e2350 (127.26.52.67:40327)
I20260807 22:40:22.388780 8654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.380580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:35243 (local address 127.26.52.65:45951)
0807 22:40:22.380751 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:22.380757 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:22.383804 (+ 3047us) server_negotiation.cc:407] Connection header received
0807 22:40:22.384075 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:22.384078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:22.384181 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:22.384242 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:22.384762 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.385567 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.387297 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.387940 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.388053 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.388115 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:22.388541 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 22:40:22.388631 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:40:22.389554 8673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.379644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:45951 (local address 127.26.52.66:35243)
0807 22:40:22.383684 (+ 4040us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:22.383703 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:22.383904 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:22.384430 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:22.384433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:22.384453 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:22.384613 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.384620 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.385727 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.385731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.387134 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.387147 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.388261 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.388265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.388378 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.388404 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:40:22.389293 (+ 889us) client_negotiation.cc:240] Negotiation successful
0807 22:40:22.389387 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3950,"thread_start_us":143,"threads_started":1}
I20260807 22:40:22.390527 8270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4998f7e55b7547489724b947fa2c95b5" candidate_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" is_pre_election: true
I20260807 22:40:22.390924 8270 raft_consensus.cc:2454] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 362d80c0cf9f40039abea4b5c2ff94c6 in term 0.
I20260807 22:40:22.391666 8356 leader_election.cc:302] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 362d80c0cf9f40039abea4b5c2ff94c6, 77ac84a5a2a046d1b31dba3ad5f59b27; no voters:
I20260807 22:40:22.392084 8670 raft_consensus.cc:2781] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:22.392208 8670 raft_consensus.cc:482] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:22.392258 8670 raft_consensus.cc:3037] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:22.393787 8670 raft_consensus.cc:504] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } }
I20260807 22:40:22.394228 8670 leader_election.cc:288] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [CANDIDATE]: Term 1 election: Requested vote from peers 77ac84a5a2a046d1b31dba3ad5f59b27 (127.26.52.65:45951), 858c50c47da64d7db1bb325ca21e2350 (127.26.52.67:40327)
I20260807 22:40:22.395188 8270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4998f7e55b7547489724b947fa2c95b5" candidate_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27"
I20260807 22:40:22.395342 8270 raft_consensus.cc:3037] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:22.397171 8270 raft_consensus.cc:2454] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 362d80c0cf9f40039abea4b5c2ff94c6 in term 1.
I20260807 22:40:22.397676 8356 leader_election.cc:302] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 362d80c0cf9f40039abea4b5c2ff94c6, 77ac84a5a2a046d1b31dba3ad5f59b27; no voters:
I20260807 22:40:22.397948 8670 raft_consensus.cc:2781] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:22.398180 8670 raft_consensus.cc:686] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 1 LEADER]: Becoming Leader. State: Replica: 362d80c0cf9f40039abea4b5c2ff94c6, State: Running, Role: LEADER
I20260807 22:40:22.398635 8670 consensus_queue.cc:237] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } }
I20260807 22:40:22.402001 8667 raft_consensus.cc:482] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:22.402199 8667 raft_consensus.cc:504] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } }
I20260807 22:40:22.402655 8657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.380752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:45649 (local address 127.26.52.67:40327)
0807 22:40:22.380890 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:22.380895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:22.388165 (+ 7270us) server_negotiation.cc:407] Connection header received
0807 22:40:22.398456 (+ 10291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:22.398460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:22.398515 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:22.398562 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:22.398996 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.399776 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.401313 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.401921 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.402023 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.402082 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:22.402443 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 22:40:22.402528 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:40:22.403075 8674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.380093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:40327 (local address 127.26.52.66:45649)
0807 22:40:22.388023 (+ 7930us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:22.388042 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:22.398254 (+ 10212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:22.398712 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:22.398715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:22.398733 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:22.398864 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.398870 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.399926 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.399929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.401164 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.401176 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.402183 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.402187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.402295 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.402317 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:40:22.402848 (+ 531us) client_negotiation.cc:240] Negotiation successful
0807 22:40:22.402931 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7833,"thread_start_us":125,"threads_started":1}
I20260807 22:40:22.403551 8667 leader_election.cc:288] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77ac84a5a2a046d1b31dba3ad5f59b27 (127.26.52.65:45951), 362d80c0cf9f40039abea4b5c2ff94c6 (127.26.52.66:38553)
I20260807 22:40:22.406733 8122 catalog_manager.cc:5495] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 362d80c0cf9f40039abea4b5c2ff94c6 (127.26.52.66). New cstate: current_term: 1 leader_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 38553 } health_report { overall_health: HEALTHY } } }
I20260807 22:40:22.410358 8574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4998f7e55b7547489724b947fa2c95b5" candidate_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858c50c47da64d7db1bb325ca21e2350" is_pre_election: true
I20260807 22:40:22.410624 8574 raft_consensus.cc:2454] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 362d80c0cf9f40039abea4b5c2ff94c6 in term 0.
I20260807 22:40:22.410974 8572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4998f7e55b7547489724b947fa2c95b5" candidate_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858c50c47da64d7db1bb325ca21e2350"
I20260807 22:40:22.411094 8572 raft_consensus.cc:3037] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:22.413096 8572 raft_consensus.cc:2454] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 362d80c0cf9f40039abea4b5c2ff94c6 in term 1.
I20260807 22:40:22.418045 8654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.404369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:50643 (local address 127.26.52.65:45951)
0807 22:40:22.405343 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:22.405348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:22.408427 (+ 3079us) server_negotiation.cc:407] Connection header received
0807 22:40:22.408645 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:22.408649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:22.408700 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:22.408749 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:22.409179 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.409989 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.416492 (+ 6503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.417169 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.417292 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.417354 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:22.417775 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 22:40:22.417882 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876}
I20260807 22:40:22.418789 8678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.403928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:45951 (local address 127.26.52.67:50643)
0807 22:40:22.408315 (+ 4387us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:22.408332 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:22.408517 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:22.408897 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:22.408900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:22.408919 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:22.409035 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.409044 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.410151 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.410154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.416171 (+ 6017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.416191 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.417479 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.417483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.417577 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.417605 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 22:40:22.418497 (+ 892us) client_negotiation.cc:240] Negotiation successful
0807 22:40:22.418618 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4307,"thread_start_us":117,"threads_started":1}
I20260807 22:40:22.419572 8270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4998f7e55b7547489724b947fa2c95b5" candidate_uuid: "858c50c47da64d7db1bb325ca21e2350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" is_pre_election: true
I20260807 22:40:22.419852 8270 raft_consensus.cc:2379] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 858c50c47da64d7db1bb325ca21e2350 in current term 1: Already voted for candidate 362d80c0cf9f40039abea4b5c2ff94c6 in this term.
I20260807 22:40:22.425729 8658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.405562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:33481 (local address 127.26.52.66:38553)
0807 22:40:22.405997 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:22.406002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:22.421146 (+ 15144us) server_negotiation.cc:407] Connection header received
0807 22:40:22.421434 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:22.421438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:22.421498 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:22.421550 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:22.422115 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.422858 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.424345 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.424967 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.425073 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.425132 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:22.425492 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 22:40:22.425583 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341}
I20260807 22:40:22.426537 8678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.404610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:38553 (local address 127.26.52.67:33481)
0807 22:40:22.421051 (+ 16441us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:22.421070 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:22.421246 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:22.421725 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:22.421729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:22.421749 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:22.421840 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.421846 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.423030 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.423034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.424200 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.424211 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.425238 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.425241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.425335 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.425360 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:40:22.426295 (+ 935us) client_negotiation.cc:240] Negotiation successful
0807 22:40:22.426388 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16366,"thread_start_us":125,"threads_started":1}
I20260807 22:40:22.427449 8409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4998f7e55b7547489724b947fa2c95b5" candidate_uuid: "858c50c47da64d7db1bb325ca21e2350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "362d80c0cf9f40039abea4b5c2ff94c6" is_pre_election: true
I20260807 22:40:22.428591 8504 leader_election.cc:302] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 858c50c47da64d7db1bb325ca21e2350; no voters: 362d80c0cf9f40039abea4b5c2ff94c6, 77ac84a5a2a046d1b31dba3ad5f59b27
I20260807 22:40:22.429253 8667 raft_consensus.cc:2726] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 22:40:22.503751 8658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.498525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33036 (local address 127.26.52.66:38553)
0807 22:40:22.498680 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:22.498684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:22.498984 (+ 300us) server_negotiation.cc:407] Connection header received
0807 22:40:22.499158 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:22.499162 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:22.499243 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:22.499373 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:22.499672 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.500538 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.501881 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.502241 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.502358 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.502873 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:22.503342 (+ 469us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:22.503484 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:22.503526 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 22:40:22.503584 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 22:40:22.511708 8270 raft_consensus.cc:1261] T 4998f7e55b7547489724b947fa2c95b5 P 77ac84a5a2a046d1b31dba3ad5f59b27 [term 1 FOLLOWER]: Refusing update from remote peer 362d80c0cf9f40039abea4b5c2ff94c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:22.511806 8572 raft_consensus.cc:1261] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 1 FOLLOWER]: Refusing update from remote peer 362d80c0cf9f40039abea4b5c2ff94c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:22.512817 8675 consensus_queue.cc:1035] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858c50c47da64d7db1bb325ca21e2350" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:22.513381 8675 consensus_queue.cc:1035] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77ac84a5a2a046d1b31dba3ad5f59b27" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:22.524525 8681 mvcc.cc:205] Tried to move back new op lower bound from 7316039362597265408 to 7316039362149244928. Current Snapshot: MvccSnapshot[applied={T|T < 7316039362597265408}]
I20260807 22:40:22.525902 8683 mvcc.cc:205] Tried to move back new op lower bound from 7316039362597265408 to 7316039362149244928. Current Snapshot: MvccSnapshot[applied={T|T < 7316039362597265408}]
I20260807 22:40:22.530654 8684 mvcc.cc:205] Tried to move back new op lower bound from 7316039362597265408 to 7316039362149244928. Current Snapshot: MvccSnapshot[applied={T|T < 7316039362597265408}]
I20260807 22:40:22.542095 8122 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:22.542327 8122 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:22.545668 8122 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8323a0bc39d4a7ba5c3ce3de5af6206: Sending DeleteTablet for 3 replicas of tablet 4998f7e55b7547489724b947fa2c95b5
I20260807 22:40:22.547161 8265 tablet_service.cc:1514] Processing DeleteTablet for tablet 4998f7e55b7547489724b947fa2c95b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:22 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:39898
I20260807 22:40:22.547767 8551 tablet_service.cc:1514] Processing DeleteTablet for tablet 4998f7e55b7547489724b947fa2c95b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:22 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:55274
I20260807 22:40:22.548429 8392 tablet_service.cc:1514] Processing DeleteTablet for tablet 4998f7e55b7547489724b947fa2c95b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:22 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:33026
I20260807 22:40:22.549008 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 8165
I20260807 22:40:22.552700 8697 tablet_replica.cc:330] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: stopping tablet replica
I20260807 22:40:22.553110 8697 raft_consensus.cc:2229] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:22.553607 8697 raft_consensus.cc:2258] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:22.555384 8697 ts_tablet_manager.cc:1905] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:22.559206 8697 ts_tablet_manager.cc:1918] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:22.559378 8697 log.cc:1196] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/4998f7e55b7547489724b947fa2c95b5
I20260807 22:40:22.559791 8697 ts_tablet_manager.cc:1939] T 4998f7e55b7547489724b947fa2c95b5 P 362d80c0cf9f40039abea4b5c2ff94c6: Deleting consensus metadata
W20260807 22:40:22.560017 8105 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:45951 (error 108)
I20260807 22:40:22.561055 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 8338
I20260807 22:40:22.562093 8108 catalog_manager.cc:4841] TS 362d80c0cf9f40039abea4b5c2ff94c6 (127.26.52.66:38553): tablet 4998f7e55b7547489724b947fa2c95b5 (table test-table [id=9c8613431d1b40e896253f1ae9211601]) successfully deleted
I20260807 22:40:22.562155 8696 tablet_replica.cc:330] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: stopping tablet replica
I20260807 22:40:22.562577 8696 raft_consensus.cc:2229] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:22.562958 8696 raft_consensus.cc:2258] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:22.564914 8696 ts_tablet_manager.cc:1905] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:22.565516 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.564702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:45951 (local address 127.0.0.1:39910)
0807 22:40:22.565297 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:22.565386 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:45951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":82,"threads_started":1}
W20260807 22:40:22.565721 8105 catalog_manager.cc:4584] TS 77ac84a5a2a046d1b31dba3ad5f59b27 (127.26.52.65:45951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4998f7e55b7547489724b947fa2c95b5: Network error: Client connection negotiation failed: client connection to 127.26.52.65:45951: connect: Connection refused (error 111)
I20260807 22:40:22.569142 8696 ts_tablet_manager.cc:1918] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:22.569281 8696 log.cc:1196] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/4998f7e55b7547489724b947fa2c95b5
I20260807 22:40:22.569703 8696 ts_tablet_manager.cc:1939] T 4998f7e55b7547489724b947fa2c95b5 P 858c50c47da64d7db1bb325ca21e2350: Deleting consensus metadata
I20260807 22:40:22.571411 8105 catalog_manager.cc:4841] TS 858c50c47da64d7db1bb325ca21e2350 (127.26.52.67:40327): tablet 4998f7e55b7547489724b947fa2c95b5 (table test-table [id=9c8613431d1b40e896253f1ae9211601]) successfully deleted
I20260807 22:40:22.572023 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 8481
I20260807 22:40:22.583496 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 8087
I20260807 22:40:22.593693 26833 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 22:40:22.939553 26833 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 22:40:22.939693 26833 mini_ranger.cc:66] Stopping Ranger...
I20260807 22:40:23.296061 26833 mini_ranger.cc:68] Stopped Ranger
2026-08-07 22:40:23.296 UTC [7084] LOG: received smart shutdown request
2026-08-07 22:40:23.301 UTC [7084] LOG: background worker "logical replication launcher" (PID 7094) exited with exit code 1
2026-08-07 22:40:23.301 UTC [7088] LOG: shutting down
2026-08-07 22:40:23.502 UTC [7084] LOG: database system is shut down
2026-08-07T22:40:23Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52047 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:23 dist-test-slave-8w9v krb5kdc[8715](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:23 dist-test-slave-8w9v krb5kdc[8715](info): set up 2 sockets
Aug 07 22:40:23 dist-test-slave-8w9v krb5kdc[8715](info): commencing operation
krb5kdc: starting...
W20260807 22:40:24.724817 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:40:24 dist-test-slave-8w9v krb5kdc[8715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:40:24.868201 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40611
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:39463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:40611,127.26.52.125:34991,127.26.52.124:43211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:24.991724 8728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:24.992084 8728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:24.992201 8728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:24.996411 8728 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:24.996507 8728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:24.996547 8728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:24.996603 8728 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:24.996652 8728 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:25.002373 8728 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:40611,127.26.52.125:34991,127.26.52.124:43211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:25.003659 8728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:25.004860 8728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:25.014209 8736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:25.014374 8728 server_base.cc:1034] running on GCE node
W20260807 22:40:25.014274 8733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:25.014595 8734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:25.015230 8728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:25.016567 8728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:25.017748 8728 hybrid_clock.cc:648] HybridClock initialized: now 1786142425017735 us; error 35 us; skew 500 ppm
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:25.020879 8728 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:40:25.021981 8728 webserver.cc:460] Webserver started at http://127.26.52.126:44731/ using document root <none> and password file <none>
I20260807 22:40:25.022652 8728 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:25.022735 8728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:25.022933 8728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:25.025362 8728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "69c7ce0aa4c3452a8b5c41605a2d9683"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-8w9v"
server_key: "068867bc6fe0f5422e46a2bf0ea608bb"
server_key_iv: "4d974c6f4c2e11817189430554160380"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.026016 8728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "69c7ce0aa4c3452a8b5c41605a2d9683"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-8w9v"
server_key: "068867bc6fe0f5422e46a2bf0ea608bb"
server_key_iv: "4d974c6f4c2e11817189430554160380"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.030440 8728 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:40:25.033342 8743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.034794 8728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:25.034958 8728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "69c7ce0aa4c3452a8b5c41605a2d9683"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-8w9v"
server_key: "068867bc6fe0f5422e46a2bf0ea608bb"
server_key_iv: "4d974c6f4c2e11817189430554160380"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.035068 8728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:25.071152 8728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:25.074411 8728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:25.074584 8728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:25.082887 8728 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:40611
I20260807 22:40:25.082902 8800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:40611 every 8 connection(s)
I20260807 22:40:25.083981 8728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:25.086920 8801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.087028 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 8728
I20260807 22:40:25.087168 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:40:25.087476 26833 external_mini_cluster.cc:1428] Setting key 2ca24d9645cadf68046c8895248c2291
I20260807 22:40:25.090979 8801 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.52.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.125@KRBTEST.COM" created.
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:25.108027 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.094075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43114 (local address 127.26.52.126:40611)
0807 22:40:25.094344 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.094353 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.094388 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:40:25.095490 (+ 1102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.095495 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.095680 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.095833 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.096927 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.097922 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.099005 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.099539 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.099689 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.102243 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.102253 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.102270 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.102302 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.104402 (+ 2100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.104962 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.104968 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.104970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.105086 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.105475 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.105480 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.105481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.105953 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.106111 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.106548 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.106855 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":166,"thread_start_us":95,"threads_started":1}
I20260807 22:40:25.108027 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.093327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40611 (local address 127.0.0.1:43114)
0807 22:40:25.093878 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.093945 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.095132 (+ 1187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.095912 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.095919 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.096442 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.096776 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.096791 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.098039 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.098042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.098874 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.098884 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.099724 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.099728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.099813 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.100473 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.100490 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.102082 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.104527 (+ 2445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.104539 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.104550 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.104816 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.105212 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.105216 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.105220 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.105359 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.106078 (+ 719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.106085 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.106246 (+ 161us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.106467 (+ 221us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.106909 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":101,"thread_start_us":111,"threads_started":1}
I20260807 22:40:25.110852 8801 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:40:25.111687 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.111345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:34991 (local address 127.0.0.1:46542)
0807 22:40:25.111498 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.111616 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 22:40:25.111884 8746 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.52.125:34991: connect: Connection refused (error 111)
I20260807 22:40:25.112835 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.112626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:34991 (local address 127.0.0.1:46548)
0807 22:40:25.112737 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.112782 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 22:40:25.113049 8801 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.125:34991: Network error: Client connection negotiation failed: client connection to 127.26.52.125:34991: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab.
Entry for principal kudu/127.26.52.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab.
I20260807 22:40:25.117159 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.125:34991
--webserver_interface=127.26.52.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab
--principal=kudu/127.26.52.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:39463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:40611,127.26.52.125:34991,127.26.52.124:43211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:40:25.162312 8801 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } attempt: 1
I20260807 22:40:25.163298 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.162941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:34991 (local address 127.0.0.1:46558)
0807 22:40:25.163121 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.163198 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 22:40:25.164084 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.163842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:34991 (local address 127.0.0.1:46560)
0807 22:40:25.163958 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.164013 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 22:40:25.164273 8801 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.125:34991: Network error: Client connection negotiation failed: client connection to 127.26.52.125:34991: connect: Connection refused (error 111)
I20260807 22:40:25.232473 8801 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } attempt: 2
I20260807 22:40:25.233484 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.233070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:34991 (local address 127.0.0.1:46568)
0807 22:40:25.233276 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.233362 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 22:40:25.234306 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.234068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:34991 (local address 127.0.0.1:46572)
0807 22:40:25.234186 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.234239 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:34991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 22:40:25.234493 8801 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.125:34991: Network error: Client connection negotiation failed: client connection to 127.26.52.125:34991: connect: Connection refused (error 111)
W20260807 22:40:25.236677 8808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:25.236966 8808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:25.237043 8808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:25.241554 8808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:25.241628 8808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:25.241650 8808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:25.241667 8808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:25.241712 8808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:25.247617 8808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:40611,127.26.52.125:34991,127.26.52.124:43211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab
--principal=kudu/127.26.52.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.125:34991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.52.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:25.249035 8808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:25.250407 8808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:25.260437 8814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:25.260438 8816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:25.260514 8813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:25.260800 8808 server_base.cc:1034] running on GCE node
I20260807 22:40:25.261700 8808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:25.263242 8808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:25.264593 8808 hybrid_clock.cc:648] HybridClock initialized: now 1786142425264509 us; error 94 us; skew 500 ppm
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:25.268874 8808 init.cc:377] Logged in from keytab as kudu/127.26.52.125@KRBTEST.COM (short username kudu)
I20260807 22:40:25.270074 8808 webserver.cc:460] Webserver started at http://127.26.52.125:43585/ using document root <none> and password file <none>
I20260807 22:40:25.270762 8808 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:25.270859 8808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:25.271122 8808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:25.273523 8808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/data/instance:
uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-8w9v"
server_key: "a1f9bf0b6d1ff85975bafc8760597cff"
server_key_iv: "9131028e2a8a89b89988871c81abca02"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.274145 8808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/wal/instance:
uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-8w9v"
server_key: "a1f9bf0b6d1ff85975bafc8760597cff"
server_key_iv: "9131028e2a8a89b89988871c81abca02"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.278534 8808 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:40:25.281766 8823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.283146 8808 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:40:25.283325 8808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/wal
uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-8w9v"
server_key: "a1f9bf0b6d1ff85975bafc8760597cff"
server_key_iv: "9131028e2a8a89b89988871c81abca02"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.283469 8808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:25.309976 8808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:25.313637 8808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:25.313890 8808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:25.321552 8808 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.125:34991
I20260807 22:40:25.321563 8880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.125:34991 every 8 connection(s)
I20260807 22:40:25.322623 8808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
I20260807 22:40:25.325206 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 8808
I20260807 22:40:25.325368 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-1/wal/instance
I20260807 22:40:25.325690 26833 external_mini_cluster.cc:1428] Setting key 8bd395214735d2735f90d6ad4a7356d5
I20260807 22:40:25.325680 8801 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } attempt: 3
I20260807 22:40:25.326126 8881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.332651 8881 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.124@KRBTEST.COM" created.
I20260807 22:40:25.341267 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.326274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:34991 (local address 127.0.0.1:46586)
0807 22:40:25.326517 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.326531 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.326616 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.329867 (+ 3251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.329870 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.330092 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.330237 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.330248 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.331685 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.331692 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.332328 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.332339 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.333125 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.333129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.333253 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.333860 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.333874 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.335354 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.338162 (+ 2808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.338165 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.338167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.338392 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.338801 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.338804 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.338806 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.338941 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.340635 (+ 1694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.340638 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.340747 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.340874 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.341050 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:25.342876 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.327314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46586 (local address 127.26.52.125:34991)
0807 22:40:25.327779 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.327800 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.327850 (+ 50us) server_negotiation.cc:407] Connection header received
0807 22:40:25.328993 (+ 1143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.329022 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.329530 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.329923 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.330446 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.331484 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.332449 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.332977 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.333168 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.335648 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.335658 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.335680 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.335720 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.337863 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.338564 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.338569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.338575 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.338701 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.339307 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.339313 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.339314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.340501 (+ 1187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.340683 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.341194 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.341584 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":163,"threads_started":1}
I20260807 22:40:25.345455 8801 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:40:25.346359 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.345999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39670)
0807 22:40:25.346167 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.346242 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 22:40:25.347533 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.347168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39678)
0807 22:40:25.347393 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.347461 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
W20260807 22:40:25.347748 8801 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:43211: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
I20260807 22:40:25.348105 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.335335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43124 (local address 127.26.52.126:40611)
0807 22:40:25.335500 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.335505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.335906 (+ 401us) server_negotiation.cc:407] Connection header received
0807 22:40:25.336427 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.336433 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.336489 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.336577 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.337563 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.338390 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.339706 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.340316 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.340449 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.343410 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.343416 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.343422 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.343474 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.345507 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.346273 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.346280 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.346285 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.346390 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.346764 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.346767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.346769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.347058 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.347171 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.347860 (+ 689us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.348008 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:40:25.348675 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.335260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40611 (local address 127.0.0.1:43124)
0807 22:40:25.335769 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.335826 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.336013 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.336620 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.336626 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.337150 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.337405 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.337417 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.338542 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.338546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.339420 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.339459 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.340493 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.340498 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.340636 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.341582 (+ 946us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.341595 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.343243 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.345687 (+ 2444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.345701 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.345724 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.346121 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.346531 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.346537 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.346543 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.346647 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.347174 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.347185 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.347430 (+ 245us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.348298 (+ 868us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.348524 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":151,"threads_started":1}
I20260807 22:40:25.350061 8881 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
I20260807 22:40:25.359830 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.350761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:34991 (local address 127.0.0.1:46600)
0807 22:40:25.350889 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.350907 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.350994 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.351277 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.351280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.351439 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.351546 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.351552 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.352756 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.352759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.353288 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.353297 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.353809 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.353812 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.353891 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.354491 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.354503 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.355887 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.358102 (+ 2215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.358105 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.358107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.358354 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.358713 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.358716 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.358717 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.358807 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.359241 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.359243 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.359345 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.359449 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.359592 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 22:40:25.359858 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.350851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46600 (local address 127.26.52.125:34991)
0807 22:40:25.350988 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.350994 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.351011 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:40:25.351082 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.351085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.351138 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.351237 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.351674 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.352634 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.353411 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.353696 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.353791 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.356195 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.356200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.356202 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.356226 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.357959 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.358522 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.358525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.358526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.358605 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.358900 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.358903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.358904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.359111 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.359191 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.359510 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.359670 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":58}
I20260807 22:40:25.361303 8881 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:40:25.362277 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.361960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39692)
0807 22:40:25.362108 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.362203 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 22:40:25.362628 8824 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
I20260807 22:40:25.363662 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.363382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39696)
0807 22:40:25.363510 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.363582 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab.
Entry for principal kudu/127.26.52.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab.
W20260807 22:40:25.363824 8881 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:43211: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
I20260807 22:40:25.364706 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.124:43211
--webserver_interface=127.26.52.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab
--principal=kudu/127.26.52.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:39463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:40611,127.26.52.125:34991,127.26.52.124:43211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:40:25.379000 8801 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } attempt: 1
I20260807 22:40:25.380213 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.379749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39702)
0807 22:40:25.379959 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.380031 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260807 22:40:25.381235 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.380948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39718)
0807 22:40:25.381096 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.381160 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 22:40:25.381399 8801 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:43211: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
I20260807 22:40:25.413108 8881 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } attempt: 1
I20260807 22:40:25.414064 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.413759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39728)
0807 22:40:25.413923 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.413988 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 22:40:25.414829 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.414612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39736)
0807 22:40:25.414723 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.414774 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 22:40:25.414943 8881 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:43211: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
I20260807 22:40:25.456573 8801 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } attempt: 2
I20260807 22:40:25.457434 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.457119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39742)
0807 22:40:25.457278 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.457350 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 22:40:25.458195 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.457976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39748)
0807 22:40:25.458086 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.458141 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 22:40:25.458355 8801 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:43211: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
I20260807 22:40:25.483134 8881 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } attempt: 2
I20260807 22:40:25.484244 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.483819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39756)
0807 22:40:25.484001 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.484077 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 22:40:25.485070 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.484806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39766)
0807 22:40:25.484936 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.485004 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 22:40:25.485219 8881 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:43211: Network error: Client connection negotiation failed: client connection to 127.26.52.124:43211: connect: Connection refused (error 111)
W20260807 22:40:25.486959 8888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:25.487272 8888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:25.487365 8888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:25.491784 8888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:25.491869 8888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:25.491936 8888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:25.491987 8888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:25.492026 8888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:25.497779 8888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:40611,127.26.52.125:34991,127.26.52.124:43211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab
--principal=kudu/127.26.52.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.124:43211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.52.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:25.499022 8888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:25.500168 8888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:25.509137 8896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:25.509137 8893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:25.509466 8888 server_base.cc:1034] running on GCE node
W20260807 22:40:25.509155 8894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:25.510164 8888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:25.511360 8888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:25.512540 8888 hybrid_clock.cc:648] HybridClock initialized: now 1786142425512528 us; error 28 us; skew 500 ppm
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:25.515318 8888 init.cc:377] Logged in from keytab as kudu/127.26.52.124@KRBTEST.COM (short username kudu)
I20260807 22:40:25.516340 8888 webserver.cc:460] Webserver started at http://127.26.52.124:38405/ using document root <none> and password file <none>
I20260807 22:40:25.516943 8888 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:25.517033 8888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:25.517272 8888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:25.519433 8888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/data/instance:
uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-8w9v"
server_key: "772309402ab2275e87f5bb703d92a170"
server_key_iv: "21eff2eb2d2b38e442d7284f63d4712d"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.520025 8888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/wal/instance:
uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-8w9v"
server_key: "772309402ab2275e87f5bb703d92a170"
server_key_iv: "21eff2eb2d2b38e442d7284f63d4712d"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.524024 8888 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:40:25.526643 8904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.527915 8888 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:25.528079 8888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/wal
uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-8w9v"
server_key: "772309402ab2275e87f5bb703d92a170"
server_key_iv: "21eff2eb2d2b38e442d7284f63d4712d"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.528270 8888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:25.543783 8888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:25.546845 8888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:25.547073 8888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:25.554510 8888 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.124:43211
I20260807 22:40:25.554526 8959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.124:43211 every 8 connection(s)
I20260807 22:40:25.555509 8888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
I20260807 22:40:25.557520 8801 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } attempt: 3
I20260807 22:40:25.558589 8960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.562505 8960 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:40:25.562842 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 8888
I20260807 22:40:25.563004 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142258649536-26833-0/minicluster-data/master-2/wal/instance
I20260807 22:40:25.563300 26833 external_mini_cluster.cc:1428] Setting key 5d09236a00980d74addf915a17b88b5a
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:40:25.570340 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.558039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39772)
0807 22:40:25.558175 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.558194 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.558285 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.560583 (+ 2298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.560586 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.560797 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.560909 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.560916 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.562213 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.562219 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.562738 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.562747 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.563669 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.563673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.563757 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.564322 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.564333 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.565933 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.568254 (+ 2321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.568259 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.568261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.568491 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.568862 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.568867 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.568869 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.569018 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.569806 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.569809 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.569910 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.570031 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.570170 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:40:25.571400 8963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.558766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39772 (local address 127.26.52.124:43211)
0807 22:40:25.559229 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.559245 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.559281 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:40:25.559927 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.559942 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.560323 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.560644 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.561092 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.562083 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.562858 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.563543 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.563724 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.566141 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.566149 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.566164 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.566199 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.568094 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.568602 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.568609 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.568615 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.568762 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.569120 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.569124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.569126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.569664 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.569836 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.570193 (+ 357us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.570510 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":161,"threads_started":1}
I20260807 22:40:25.576380 8966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.564031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39784 (local address 127.26.52.124:43211)
0807 22:40:25.564389 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.564400 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.565109 (+ 709us) server_negotiation.cc:407] Connection header received
0807 22:40:25.565219 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.565222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.565264 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.565479 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.566602 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.567444 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.568649 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.569049 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.569135 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.571979 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.571982 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.571983 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.572004 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.574344 (+ 2340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.574841 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.574844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.574852 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.574953 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.575227 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.575231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.575233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.575469 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.575645 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.575864 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.576005 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":290,"thread_start_us":164,"threads_started":1}
I20260807 22:40:25.576356 8801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683: Bootstrap starting.
I20260807 22:40:25.576388 8881 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } attempt: 3
I20260807 22:40:25.576732 8967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.564888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40611 (local address 127.0.0.1:43132)
0807 22:40:25.565362 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.565412 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.565619 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.566004 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.566011 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.566344 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.566481 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.566494 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.567373 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.567375 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.568385 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.568396 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.568893 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.568896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.569070 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.569629 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.569661 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.572870 (+ 3209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.574810 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.574822 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.574828 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.575131 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.575458 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.575461 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.575463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.575559 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.576085 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.576090 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.576233 (+ 143us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.576382 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.576574 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":42,"spinlock_wait_cycles":1280,"thread_start_us":89,"threads_started":1}
I20260807 22:40:25.577502 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.564939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43132 (local address 127.26.52.126:40611)
0807 22:40:25.565065 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.565070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.565489 (+ 419us) server_negotiation.cc:407] Connection header received
0807 22:40:25.565772 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.565778 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.565832 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.565932 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.566633 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.567222 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.568517 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.568788 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.568893 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.573002 (+ 4109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.573008 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.573015 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.573046 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.574687 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.575267 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.575273 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.575277 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.575354 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.575672 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.575676 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.575678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.575907 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.575996 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.577205 (+ 1209us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.577340 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:40:25.578522 8960 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:40:25.580662 8801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.581753 8801 log.cc:824] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:40:25.584292 8801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683: No bootstrap required, opened a new log
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:25.587512 8963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.577073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39798 (local address 127.26.52.124:43211)
0807 22:40:25.577242 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.577248 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.577262 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:40:25.577300 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.577305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.577345 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.577926 (+ 581us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.578016 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.578720 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.579991 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.580336 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.583343 (+ 3007us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.583468 (+ 125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.583471 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.583474 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.583493 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.585144 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.585666 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.585670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.585672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.586002 (+ 330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.586581 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.586583 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.586585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.586815 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.586975 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.587248 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.587360 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 22:40:25.587527 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.576825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39798)
0807 22:40:25.576964 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.576979 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.577068 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.577493 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.577496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.577700 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.577811 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.577818 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.578859 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.578863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.579624 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.579635 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.580518 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.580524 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.580626 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.581175 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.581190 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.582975 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.585269 (+ 2294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.585275 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.585280 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.585550 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.586106 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.586111 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.586115 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.586222 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.586974 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.586977 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.587079 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.587185 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.587336 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":1}
I20260807 22:40:25.589264 8801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } }
I20260807 22:40:25.589489 8801 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.589564 8801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c7ce0aa4c3452a8b5c41605a2d9683, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.590060 8801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } }
I20260807 22:40:25.590332 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.578050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43138 (local address 127.26.52.126:40611)
0807 22:40:25.578599 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.578605 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.578625 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:40:25.578658 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.578660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.578700 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.578772 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.579623 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.580291 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.581423 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.581734 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.581808 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.585488 (+ 3680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.585492 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.585495 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.585519 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.587390 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.588755 (+ 1365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.588759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.588761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.588853 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.589171 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.589174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.589176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.589374 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.589679 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.590060 (+ 381us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.590187 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474}
I20260807 22:40:25.590758 8969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } } }
I20260807 22:40:25.590903 8969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:25.591171 8881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4: Bootstrap starting.
I20260807 22:40:25.591495 8801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:25.594080 8881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.594470 8967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.579001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:34991 (local address 127.0.0.1:46606)
0807 22:40:25.579779 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.579793 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.579873 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.580207 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.580210 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.580384 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.580504 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.580511 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.581507 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.581510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.582266 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.582276 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.582803 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.582807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.582907 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.583342 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.583360 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.585740 (+ 2380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.588342 (+ 2602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.588348 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.588466 (+ 118us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.592852 (+ 4386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.593230 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.593234 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.593237 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.593342 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.593926 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.593930 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.594046 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.594154 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.594298 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711}
I20260807 22:40:25.594579 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.579246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46606 (local address 127.26.52.125:34991)
0807 22:40:25.579360 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.579364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.579862 (+ 498us) server_negotiation.cc:407] Connection header received
0807 22:40:25.579958 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.579961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.580003 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.580075 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.580632 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.581367 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.582390 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.582602 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.582714 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.585864 (+ 3150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.585868 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.585871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.585894 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.588243 (+ 2349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.592977 (+ 4734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.592980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.592983 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.593086 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.593483 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.593487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.593489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.593772 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.593859 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.594311 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.594445 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 22:40:25.595055 8881 log.cc:824] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:25.595656 8960 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:40:25.598322 8881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4: No bootstrap required, opened a new log
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
Aug 07 22:40:25 dist-test-slave-8w9v krb5kdc[8715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:40:25.597116 8728 master_runner.cc:186] Error getting master registration for 127.26.52.125:34991: OK, instance_id { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" instance_seqno: 1786142425319247 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:40:25.602275 8728 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:40:25.602545 8881 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } }
I20260807 22:40:25.602766 8881 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.602821 8881 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe42fe317d3b44aaa94cc4f1f7a178a4, State: Initialized, Role: FOLLOWER
W20260807 22:40:25.603212 8981 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:40:25.603283 8981 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:40:25.603295 8881 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } }
I20260807 22:40:25.604715 8881 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:25.606493 8967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.596328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:43211 (local address 127.0.0.1:39810)
0807 22:40:25.596507 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.596522 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.596590 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.597029 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.597031 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.597193 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.597263 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.597268 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.598221 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.598224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.598990 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.598999 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.599977 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.599981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.600087 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.600622 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.600637 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.602313 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.604953 (+ 2640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.604957 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.604958 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.605201 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.605491 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.605494 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.605496 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.605581 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.606001 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.606007 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.606093 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.606186 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.606309 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260807 22:40:25.607172 8963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.596704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39810 (local address 127.26.52.124:43211)
0807 22:40:25.596804 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.596808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.596818 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:25.596845 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.596848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.596882 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.596946 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.597375 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.598111 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.599099 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.599755 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.599862 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.602551 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.602555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.602558 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.602579 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.604850 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.605300 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.605306 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.605310 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.605384 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.605677 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.605680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.605682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.605875 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.605966 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.606757 (+ 791us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.606924 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:40:25.606982 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.593770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46612 (local address 127.26.52.125:34991)
0807 22:40:25.594715 (+ 945us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.594719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.594733 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:40:25.594765 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.594768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.594807 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.594883 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.596557 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.597301 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.598380 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.598708 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.598800 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.602525 (+ 3725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.602529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.602532 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.602556 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.604388 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.604972 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.604976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.604977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.605055 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.605371 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.605375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.605377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.605595 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.605763 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.606443 (+ 680us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.606785 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":889,"thread_start_us":144,"threads_started":1}
I20260807 22:40:25.610409 8960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92: Bootstrap starting.
I20260807 22:40:25.611147 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:40:25.614377 8960 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.615346 8960 log.cc:824] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:25.616309 8985 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } } }
I20260807 22:40:25.616464 8985 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:25.616564 8985 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:25.616704 8985 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } }
I20260807 22:40:25.617868 8985 leader_election.cc:288] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69c7ce0aa4c3452a8b5c41605a2d9683 (127.26.52.126:40611), 0ba3f29cd3d74f4a90d5dd2e86655b92 (127.26.52.124:43211)
I20260807 22:40:25.616214 8808 master_runner.cc:186] Error getting master registration for 127.26.52.124:43211: OK, instance_id { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" instance_seqno: 1786142425552372 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:40:25.620090 8808 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 22:40:25.621667 8998 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:40:25.621757 8998 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:40:25.622252 8960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92: No bootstrap required, opened a new log
I20260807 22:40:25.622140 8771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" is_pre_election: true
I20260807 22:40:25.622489 8771 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe42fe317d3b44aaa94cc4f1f7a178a4 in term 0.
I20260807 22:40:25.623011 8826 leader_election.cc:302] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69c7ce0aa4c3452a8b5c41605a2d9683, fe42fe317d3b44aaa94cc4f1f7a178a4; no voters:
I20260807 22:40:25.627014 8960 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } }
I20260807 22:40:25.627326 8960 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.627408 8960 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba3f29cd3d74f4a90d5dd2e86655b92, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.629288 9004 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:25.629789 9004 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:25.630038 9004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:25.630239 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.614228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43140 (local address 127.26.52.126:40611)
0807 22:40:25.614392 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.614397 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.616824 (+ 2427us) server_negotiation.cc:407] Connection header received
0807 22:40:25.616911 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.616914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.616965 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.617019 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.618065 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.622589 (+ 4524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.623881 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.624257 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.624345 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.626409 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.626413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.626417 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.626452 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.628223 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.628750 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.628754 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.628755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.628859 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.629177 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.629180 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.629182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.629415 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.629536 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.629928 (+ 392us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.630067 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 22:40:25.632601 8960 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } }
I20260807 22:40:25.637717 8960 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:25.637785 8933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" is_pre_election: true
I20260807 22:40:25.638123 8933 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe42fe317d3b44aaa94cc4f1f7a178a4 in term 0.
I20260807 22:40:25.640787 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.615373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46622 (local address 127.26.52.125:34991)
0807 22:40:25.615486 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.615490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.628026 (+ 12536us) server_negotiation.cc:407] Connection header received
0807 22:40:25.628312 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.628315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.628381 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.628440 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.629312 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.630083 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.631178 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.631590 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.631679 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.634048 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.634054 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.634059 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.634094 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.635845 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.639088 (+ 3243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.639094 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.639097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.639184 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.639509 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.639512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.639514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.639751 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.639891 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.640421 (+ 530us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.640566 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:40:25.641691 9004 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } }
I20260807 22:40:25.642704 8771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683"
I20260807 22:40:25.642860 8771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:25.643515 8933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92"
I20260807 22:40:25.643651 8933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:25.644459 8771 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe42fe317d3b44aaa94cc4f1f7a178a4 in term 1.
I20260807 22:40:25.644996 8933 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe42fe317d3b44aaa94cc4f1f7a178a4 in term 1.
I20260807 22:40:25.645364 8824 leader_election.cc:302] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba3f29cd3d74f4a90d5dd2e86655b92, fe42fe317d3b44aaa94cc4f1f7a178a4; no voters:
I20260807 22:40:25.645576 8985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:25.643013 8963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.613877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39820 (local address 127.26.52.124:43211)
0807 22:40:25.615833 (+ 1956us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.615837 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.620228 (+ 4391us) server_negotiation.cc:407] Connection header received
0807 22:40:25.620281 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.620284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.620343 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.620431 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.621355 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.623894 (+ 2539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.626093 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.626548 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.628966 (+ 2418us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.631100 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.631108 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.631114 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.631166 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.636370 (+ 5204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.637299 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.637303 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.637305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.637573 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.640095 (+ 2522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.640099 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.640102 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.640375 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.640971 (+ 596us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.642710 (+ 1739us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.642855 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1890}
I20260807 22:40:25.645851 8985 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [term 1 LEADER]: Becoming Leader. State: Replica: fe42fe317d3b44aaa94cc4f1f7a178a4, State: Running, Role: LEADER
I20260807 22:40:25.646268 8985 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } }
I20260807 22:40:25.646661 9004 leader_election.cc:288] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [CANDIDATE]: Term 1 election: Requested vote from peers 69c7ce0aa4c3452a8b5c41605a2d9683 (127.26.52.126:40611), 0ba3f29cd3d74f4a90d5dd2e86655b92 (127.26.52.124:43211)
I20260807 22:40:25.648635 9004 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe42fe317d3b44aaa94cc4f1f7a178a4. Latest consensus state: current_term: 1 leader_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } } }
I20260807 22:40:25.648769 9004 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:25.651062 9024 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:25.651341 9010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } } }
I20260807 22:40:25.651575 9010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:25.652280 9024 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:25.659571 8933 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [term 1 FOLLOWER]: Refusing update from remote peer fe42fe317d3b44aaa94cc4f1f7a178a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:25.660905 8771 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [term 1 FOLLOWER]: Refusing update from remote peer fe42fe317d3b44aaa94cc4f1f7a178a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:25.662621 9004 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:25.663144 9004 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:25.668380 9010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe42fe317d3b44aaa94cc4f1f7a178a4. Latest consensus state: current_term: 1 leader_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } } }
I20260807 22:40:25.668547 9010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:25.672036 8969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe42fe317d3b44aaa94cc4f1f7a178a4. Latest consensus state: current_term: 1 leader_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } } }
I20260807 22:40:25.672235 8969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 22:40:25.675236 9021 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:40:25.675345 9021 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:40:25.679278 9022 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } } }
I20260807 22:40:25.679469 9022 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:25.680874 9010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } } }
I20260807 22:40:25.681028 9010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:25.682492 9027 mvcc.cc:205] Tried to move back new op lower bound from 7316039375492468736 to 7316039375450357760. Current Snapshot: MvccSnapshot[applied={T|T < 7316039375492468736}]
I20260807 22:40:25.686841 8985 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } } }
I20260807 22:40:25.687026 8985 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:25.688822 8969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c7ce0aa4c3452a8b5c41605a2d9683" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40611 } } peers { permanent_uuid: "fe42fe317d3b44aaa94cc4f1f7a178a4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 34991 } } peers { permanent_uuid: "0ba3f29cd3d74f4a90d5dd2e86655b92" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 43211 } } }
I20260807 22:40:25.688982 8969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:25.690100 9029 mvcc.cc:205] Tried to move back new op lower bound from 7316039375492468736 to 7316039375450357760. Current Snapshot: MvccSnapshot[applied={T|T < 7316039375492468736}]
I20260807 22:40:25.692986 9024 catalog_manager.cc:1347] Generated new cluster ID: a739981c99c9433eb3a958f09f98c8dc
I20260807 22:40:25.693068 9024 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:25.727702 9024 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:25.729831 9024 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:25.766875 9024 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe42fe317d3b44aaa94cc4f1f7a178a4: Generated new TSK 0
I20260807 22:40:25.767910 9024 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:40:26.604928 8981 catalog_manager.cc:1259] Loaded cluster ID: a739981c99c9433eb3a958f09f98c8dc
I20260807 22:40:26.605019 8981 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683: loading cluster ID for follower catalog manager: success
I20260807 22:40:26.606855 8981 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683: acquiring CA information for follower catalog manager: success
I20260807 22:40:26.608186 8981 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 69c7ce0aa4c3452a8b5c41605a2d9683: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:40:26.676893 9021 catalog_manager.cc:1259] Loaded cluster ID: a739981c99c9433eb3a958f09f98c8dc
I20260807 22:40:26.677006 9021 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92: loading cluster ID for follower catalog manager: success
I20260807 22:40:26.678632 9021 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92: acquiring CA information for follower catalog manager: success
I20260807 22:40:26.679821 9021 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0ba3f29cd3d74f4a90d5dd2e86655b92: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:40:26.848910 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 8728
I20260807 22:40:26.858156 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 8808
I20260807 22:40:26.867051 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 8888
2026-08-07T22:40:26Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3239 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:26 dist-test-slave-8w9v krb5kdc[9042](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:26 dist-test-slave-8w9v krb5kdc[9042](info): set up 2 sockets
Aug 07 22:40:26 dist-test-slave-8w9v krb5kdc[9042](info): commencing operation
krb5kdc: starting...
W20260807 22:40:27.954429 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:40:28 dist-test-slave-8w9v krb5kdc[9042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:40:28.091337 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:36379
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:36379
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:28.210743 9056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:28.211095 9056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:28.211174 9056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:28.215442 9056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:28.215564 9056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:28.215600 9056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:28.215638 9056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:28.215674 9056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:28.221591 9056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:36379
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:36379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:28.222838 9056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:28.223960 9056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:28.234264 9064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:28.234351 9056 server_base.cc:1034] running on GCE node
W20260807 22:40:28.234301 9061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:28.234266 9062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:28.235337 9056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:28.236735 9056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:28.237960 9056 hybrid_clock.cc:648] HybridClock initialized: now 1786142428237930 us; error 53 us; skew 500 ppm
Aug 07 22:40:28 dist-test-slave-8w9v krb5kdc[9042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142428, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:28.241216 9056 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:40:28.242373 9056 webserver.cc:460] Webserver started at http://127.26.52.126:34011/ using document root <none> and password file <none>
I20260807 22:40:28.243006 9056 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:28.243101 9056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:28.243368 9056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:28.245744 9056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "111f27a71fc549f6bbdc927fa4a134b8"
format_stamp: "Formatted at 2026-08-07 22:40:28 on dist-test-slave-8w9v"
server_key: "4cacf5301c39a4e742d941f4faf66f1e"
server_key_iv: "362c0517cfa2abd6ac56d1b0af6bf515"
server_key_version: "encryptionkey@0"
I20260807 22:40:28.246383 9056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "111f27a71fc549f6bbdc927fa4a134b8"
format_stamp: "Formatted at 2026-08-07 22:40:28 on dist-test-slave-8w9v"
server_key: "4cacf5301c39a4e742d941f4faf66f1e"
server_key_iv: "362c0517cfa2abd6ac56d1b0af6bf515"
server_key_version: "encryptionkey@0"
I20260807 22:40:28.250726 9056 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:40:28.253886 9072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:28.255249 9056 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:40:28.255445 9056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "111f27a71fc549f6bbdc927fa4a134b8"
format_stamp: "Formatted at 2026-08-07 22:40:28 on dist-test-slave-8w9v"
server_key: "4cacf5301c39a4e742d941f4faf66f1e"
server_key_iv: "362c0517cfa2abd6ac56d1b0af6bf515"
server_key_version: "encryptionkey@0"
I20260807 22:40:28.255590 9056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:28.279732 9056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:28.283453 9056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:28.283687 9056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:28.291458 9056 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:36379
I20260807 22:40:28.291484 9127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:36379 every 8 connection(s)
I20260807 22:40:28.292596 9056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:28.295647 9128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:28.299822 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 9056
I20260807 22:40:28.299923 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:40:28.300308 26833 external_mini_cluster.cc:1428] Setting key 6686df1a36138ecd68f36bded0dc4534
I20260807 22:40:28.302095 9128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8: Bootstrap starting.
I20260807 22:40:28.304653 9128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:28.305481 9128 log.cc:824] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:28.307598 9128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8: No bootstrap required, opened a new log
Aug 07 22:40:28 dist-test-slave-8w9v krb5kdc[9042](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:28.311905 9128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111f27a71fc549f6bbdc927fa4a134b8" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36379 } }
I20260807 22:40:28.312196 9128 raft_consensus.cc:374] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:28.312290 9128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 111f27a71fc549f6bbdc927fa4a134b8, State: Initialized, Role: FOLLOWER
I20260807 22:40:28.312804 9128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111f27a71fc549f6bbdc927fa4a134b8" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36379 } }
I20260807 22:40:28.312965 9128 raft_consensus.cc:388] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:28.313050 9128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:28.313153 9128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:28.314149 9128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111f27a71fc549f6bbdc927fa4a134b8" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36379 } }
I20260807 22:40:28.314591 9128 leader_election.cc:302] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 111f27a71fc549f6bbdc927fa4a134b8; no voters:
I20260807 22:40:28.314925 9128 leader_election.cc:288] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:28.315032 9133 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:28.315253 9133 raft_consensus.cc:686] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [term 1 LEADER]: Becoming Leader. State: Replica: 111f27a71fc549f6bbdc927fa4a134b8, State: Running, Role: LEADER
I20260807 22:40:28.315567 9131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.301812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44598 (local address 127.26.52.126:36379)
0807 22:40:28.302360 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.302376 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.302414 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:40:28.303081 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.303098 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.303460 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.303814 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:28.304743 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.305892 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.306794 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.307276 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.307462 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.310128 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:28.310133 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:28.310149 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:28.310179 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:28.312018 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.312565 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.312571 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.312575 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.312702 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.313034 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.313038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.313040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.313544 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:28.313780 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.314108 (+ 328us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.314458 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":186,"threads_started":1}
I20260807 22:40:28.315649 9133 consensus_queue.cc:237] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111f27a71fc549f6bbdc927fa4a134b8" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36379 } }
I20260807 22:40:28.316447 9128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:28.317657 9134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "111f27a71fc549f6bbdc927fa4a134b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111f27a71fc549f6bbdc927fa4a134b8" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36379 } } }
I20260807 22:40:28.317793 9134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:28.318121 9135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 111f27a71fc549f6bbdc927fa4a134b8. Latest consensus state: current_term: 1 leader_uuid: "111f27a71fc549f6bbdc927fa4a134b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "111f27a71fc549f6bbdc927fa4a134b8" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 36379 } } }
I20260807 22:40:28.318248 9135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:28.319906 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 22:40:28.322234 9150 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:40:28.322307 9150 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:40:28.322414 9144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:28.323127 9144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:28.329257 9144 catalog_manager.cc:1347] Generated new cluster ID: ca3591f46a1f40d6a16b05f26583982a
I20260807 22:40:28.329349 9144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:28.340523 9144 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:28.341542 9144 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:28.350672 9144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 111f27a71fc549f6bbdc927fa4a134b8: Generated new TSK 0
I20260807 22:40:28.351441 9144 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:40:28.376729 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 9056
2026-08-07T22:40:28Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1508 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:28 dist-test-slave-8w9v krb5kdc[9158](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:28 dist-test-slave-8w9v krb5kdc[9158](info): set up 2 sockets
Aug 07 22:40:28 dist-test-slave-8w9v krb5kdc[9158](info): commencing operation
krb5kdc: starting...
W20260807 22:40:29.459837 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:40:29 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142429, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:40:29.594973 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37263
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:37263
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:29.713538 9172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:29.713845 9172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:29.713889 9172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:29.718462 9172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:29.718550 9172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:29.718571 9172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:29.718652 9172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:29.718688 9172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:29.724730 9172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:37263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:29.725991 9172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:29.727083 9172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:29.736236 9178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:29.736223 9181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:29.736217 9179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:29.736385 9172 server_base.cc:1034] running on GCE node
I20260807 22:40:29.737149 9172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:29.738363 9172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:29.739567 9172 hybrid_clock.cc:648] HybridClock initialized: now 1786142429739547 us; error 33 us; skew 500 ppm
Aug 07 22:40:29 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142429, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:29.746539 9172 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:40:29.748071 9172 webserver.cc:460] Webserver started at http://127.26.52.126:34899/ using document root <none> and password file <none>
I20260807 22:40:29.749008 9172 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:29.749126 9172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:29.749426 9172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:29.752532 9172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "be6ca3b137bd4028898e3c85a7a2d3d1"
format_stamp: "Formatted at 2026-08-07 22:40:29 on dist-test-slave-8w9v"
server_key: "539ea1743bacc4d5728a0d87139929b7"
server_key_iv: "2b0f1baf65092098cf599decb92f5c91"
server_key_version: "encryptionkey@0"
I20260807 22:40:29.753163 9172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "be6ca3b137bd4028898e3c85a7a2d3d1"
format_stamp: "Formatted at 2026-08-07 22:40:29 on dist-test-slave-8w9v"
server_key: "539ea1743bacc4d5728a0d87139929b7"
server_key_iv: "2b0f1baf65092098cf599decb92f5c91"
server_key_version: "encryptionkey@0"
I20260807 22:40:29.757285 9172 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:40:29.759909 9188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:29.761286 9172 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:29.761446 9172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "be6ca3b137bd4028898e3c85a7a2d3d1"
format_stamp: "Formatted at 2026-08-07 22:40:29 on dist-test-slave-8w9v"
server_key: "539ea1743bacc4d5728a0d87139929b7"
server_key_iv: "2b0f1baf65092098cf599decb92f5c91"
server_key_version: "encryptionkey@0"
I20260807 22:40:29.761579 9172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:29.785770 9172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:29.789590 9172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:29.789820 9172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:29.797597 9172 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:37263
I20260807 22:40:29.797914 9240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:37263 every 8 connection(s)
I20260807 22:40:29.798700 9172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:29.801908 9241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:29.803416 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 9172
I20260807 22:40:29.803570 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:40:29.803936 26833 external_mini_cluster.cc:1428] Setting key 79b48b5e1186eeff58a027ad39b3039d
I20260807 22:40:29.808936 9241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Bootstrap starting.
I20260807 22:40:29.811887 9241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:29.812950 9241 log.cc:824] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:40:29 dist-test-slave-8w9v krb5kdc[9158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142429, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:29.815181 9241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: No bootstrap required, opened a new log
I20260807 22:40:29.818986 9245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:29.805437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56262 (local address 127.26.52.126:37263)
0807 22:40:29.805880 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:29.805903 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:29.805943 (+ 40us) server_negotiation.cc:407] Connection header received
0807 22:40:29.806578 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:29.806596 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:29.806924 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:29.807206 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:29.808219 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:29.809272 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:29.810436 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:29.810890 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:29.811008 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:29.814097 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:29.814102 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:29.814117 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:29.814143 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:29.815954 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:29.816526 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:29.816531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:29.816536 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:29.816651 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:29.816940 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:29.816942 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:29.816943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:29.817373 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:29.817539 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:29.817866 (+ 327us) server_negotiation.cc:299] Negotiation successful
0807 22:40:29.818182 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":159,"threads_started":1}
I20260807 22:40:29.819603 9241 raft_consensus.cc:348] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:29.819876 9241 raft_consensus.cc:374] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:29.819947 9241 raft_consensus.cc:729] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be6ca3b137bd4028898e3c85a7a2d3d1, State: Initialized, Role: FOLLOWER
I20260807 22:40:29.820442 9241 consensus_queue.cc:260] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:29.820607 9241 raft_consensus.cc:388] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:29.820694 9241 raft_consensus.cc:482] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:29.820829 9241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:29.821882 9241 raft_consensus.cc:504] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:29.822254 9241 leader_election.cc:302] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be6ca3b137bd4028898e3c85a7a2d3d1; no voters:
I20260807 22:40:29.822605 9241 leader_election.cc:288] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:29.822790 9247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:29.823086 9247 raft_consensus.cc:686] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 1 LEADER]: Becoming Leader. State: Replica: be6ca3b137bd4028898e3c85a7a2d3d1, State: Running, Role: LEADER
I20260807 22:40:29.823405 9247 consensus_queue.cc:237] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:29.823985 9241 sys_catalog.cc:564] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:29.825330 9249 sys_catalog.cc:455] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be6ca3b137bd4028898e3c85a7a2d3d1. Latest consensus state: current_term: 1 leader_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } } }
I20260807 22:40:29.825346 9248 sys_catalog.cc:455] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } } }
I20260807 22:40:29.825476 9248 sys_catalog.cc:458] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:29.825475 9249 sys_catalog.cc:458] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: This master's current role is: LEADER
W20260807 22:40:29.829191 9264 catalog_manager.cc:1558] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:40:29.829274 9264 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:40:29.829384 9258 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:29.830130 9258 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:29.836211 9258 catalog_manager.cc:1347] Generated new cluster ID: f32d6af287d244f19bcbb9a59fd7add6
I20260807 22:40:29.836301 9258 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:29.851076 9258 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:29.852190 9258 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:29.860718 9258 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Generated new TSK 0
I20260807 22:40:29.861613 9258 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:40:29.907663 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37263
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:30.057914 9271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:30.058215 9271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:30.058269 9271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:30.062651 9271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:30.062732 9271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:30.062846 9271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:40:30.069005 9271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:30.070271 9271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:30.071434 9271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:30.081795 9276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:30.081840 9271 server_base.cc:1034] running on GCE node
W20260807 22:40:30.081792 9277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:30.081795 9279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:30.082509 9271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:30.083139 9271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:30.084331 9271 hybrid_clock.cc:648] HybridClock initialized: now 1786142430084315 us; error 37 us; skew 500 ppm
Aug 07 22:40:30 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142430, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:30.087313 9271 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:40:30.088387 9271 webserver.cc:460] Webserver started at http://127.26.52.65:44667/ using document root <none> and password file <none>
I20260807 22:40:30.089002 9271 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:30.089097 9271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:30.089346 9271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:30.091497 9271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "6b432d90e46b43bc92c6f8e5a5068d8c"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "96cd7c85ae8332220c4946795302cdc0"
server_key_iv: "efde409a55c69de652e12a0a55af302c"
server_key_version: "encryptionkey@0"
I20260807 22:40:30.092082 9271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "6b432d90e46b43bc92c6f8e5a5068d8c"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "96cd7c85ae8332220c4946795302cdc0"
server_key_iv: "efde409a55c69de652e12a0a55af302c"
server_key_version: "encryptionkey@0"
I20260807 22:40:30.096021 9271 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260807 22:40:30.098675 9287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.100044 9271 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:30.100225 9271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "6b432d90e46b43bc92c6f8e5a5068d8c"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "96cd7c85ae8332220c4946795302cdc0"
server_key_iv: "efde409a55c69de652e12a0a55af302c"
server_key_version: "encryptionkey@0"
I20260807 22:40:30.100358 9271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:30.150261 9271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:30.153770 9271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:30.153995 9271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:30.154640 9271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:30.155520 9271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:30.155592 9271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.155671 9271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:30.155722 9271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.165033 9271 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:34069
I20260807 22:40:30.165056 9410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:34069 every 8 connection(s)
I20260807 22:40:30.166117 9271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:30.167754 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 9271
I20260807 22:40:30.167887 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:30.168282 26833 external_mini_cluster.cc:1428] Setting key bce756af84a9180826636c537928e7ea
Aug 07 22:40:30 dist-test-slave-8w9v krb5kdc[9158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142430, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:40:30.182169 9245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.168161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:54977 (local address 127.26.52.126:37263)
0807 22:40:30.168315 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.168319 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.169388 (+ 1069us) server_negotiation.cc:407] Connection header received
0807 22:40:30.170948 (+ 1560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.170954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.171021 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.171113 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:30.172580 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.173115 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.174911 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.175208 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.175292 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.178323 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:30.178329 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:30.178335 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:30.178371 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:30.180173 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:30.180694 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:30.180697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:30.180698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:30.180777 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:30.181149 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:30.181151 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:30.181152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:30.181338 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:30.181423 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.181928 (+ 505us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.182037 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:40:30.183176 9413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.168661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:54977)
0807 22:40:30.169218 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:30.169277 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:30.170727 (+ 1450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:30.171272 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:30.171278 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:30.171658 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:30.172410 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.172443 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.173250 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.173257 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.174777 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.174793 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.175380 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.175388 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.175628 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.176378 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:30.176406 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:30.178135 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:30.180289 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:30.180294 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:30.180308 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:30.180596 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:30.180857 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:30.180860 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:30.180861 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:30.181032 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:30.181449 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:30.181455 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:30.181709 (+ 254us) client_negotiation.cc:769] Sending connection context
0807 22:40:30.181870 (+ 161us) client_negotiation.cc:240] Negotiation successful
0807 22:40:30.182141 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":155,"threads_started":1}
I20260807 22:40:30.184592 9411 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37263
I20260807 22:40:30.184868 9411 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:30.185492 9411 heartbeater.cc:511] Master 127.26.52.126:37263 requested a full tablet report, sending...
I20260807 22:40:30.187255 9205 ts_manager.cc:194] Registered new tserver with Master: 6b432d90e46b43bc92c6f8e5a5068d8c (127.26.52.65:34069)
I20260807 22:40:30.189033 9205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:54977
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:40:30.203351 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37263
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:30.321817 9416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:30.322139 9416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:30.322186 9416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:30.326749 9416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:30.326829 9416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:30.326901 9416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:40:30.332630 9416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:30.333940 9416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:30.335000 9416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:30.345678 9424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:30.345757 9416 server_base.cc:1034] running on GCE node
W20260807 22:40:30.345710 9426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:30.345710 9423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:30.346463 9416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:30.347122 9416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:30.348291 9416 hybrid_clock.cc:648] HybridClock initialized: now 1786142430348272 us; error 32 us; skew 500 ppm
Aug 07 22:40:30 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142430, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:30.351343 9416 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:40:30.352319 9416 webserver.cc:460] Webserver started at http://127.26.52.66:35375/ using document root <none> and password file <none>
I20260807 22:40:30.352907 9416 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:30.352974 9416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:30.353152 9416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:30.355279 9416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "14c7e381e5654c4598623bee79542171"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "8f5da6782ac2e0dbf877a42e9ffd71c9"
server_key_iv: "fdcf7582d38e2f28ab98373bd4a066e6"
server_key_version: "encryptionkey@0"
I20260807 22:40:30.355867 9416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "14c7e381e5654c4598623bee79542171"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "8f5da6782ac2e0dbf877a42e9ffd71c9"
server_key_iv: "fdcf7582d38e2f28ab98373bd4a066e6"
server_key_version: "encryptionkey@0"
I20260807 22:40:30.359948 9416 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.007s
I20260807 22:40:30.362802 9434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.364166 9416 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:40:30.364333 9416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "14c7e381e5654c4598623bee79542171"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "8f5da6782ac2e0dbf877a42e9ffd71c9"
server_key_iv: "fdcf7582d38e2f28ab98373bd4a066e6"
server_key_version: "encryptionkey@0"
I20260807 22:40:30.364466 9416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:30.377777 9416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:30.381608 9416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:30.381848 9416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:30.382519 9416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:30.383455 9416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:30.383527 9416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.383603 9416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:30.383656 9416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.393887 9416 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:37629
I20260807 22:40:30.393911 9553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:37629 every 8 connection(s)
I20260807 22:40:30.394974 9416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:30.401166 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 9416
I20260807 22:40:30.401352 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:30.401696 26833 external_mini_cluster.cc:1428] Setting key a5778c5200e8caf1d25d8e04b5d75be3
Aug 07 22:40:30 dist-test-slave-8w9v krb5kdc[9158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142430, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:30.412550 9245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.397173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:44791 (local address 127.26.52.126:37263)
0807 22:40:30.397339 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.397344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.398375 (+ 1031us) server_negotiation.cc:407] Connection header received
0807 22:40:30.400025 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.400029 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.400104 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.400286 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:30.401799 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.402438 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.404111 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.404592 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.404732 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.407627 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:30.407634 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:30.407640 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:30.407676 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:30.409559 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:30.410475 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:30.410482 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:30.410485 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:30.410598 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:30.411066 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:30.411073 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:30.411077 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:30.411391 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:30.411499 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.412099 (+ 600us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.412316 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:40:30.413463 9557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.397613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:44791)
0807 22:40:30.398187 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:30.398237 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:30.399737 (+ 1500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:30.400513 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:30.400521 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:30.400961 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:30.401621 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.401641 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.402608 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.402612 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.403970 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.403982 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.404766 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.404769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.404998 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.405648 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:30.405666 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:30.407439 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:30.409721 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:30.409728 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:30.409743 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:30.410317 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:30.410766 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:30.410770 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:30.410771 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:30.410943 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:30.411522 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:30.411529 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:30.411818 (+ 289us) client_negotiation.cc:769] Sending connection context
0807 22:40:30.412000 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 22:40:30.412420 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":166,"threads_started":1}
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:40:30.414911 9554 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37263
I20260807 22:40:30.415217 9554 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:30.415796 9554 heartbeater.cc:511] Master 127.26.52.126:37263 requested a full tablet report, sending...
I20260807 22:40:30.417138 9205 ts_manager.cc:194] Registered new tserver with Master: 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
I20260807 22:40:30.417953 9205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:44791
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:40:30.435402 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37263
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:30.555238 9561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:30.555534 9561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:30.555608 9561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:30.559813 9561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:30.559895 9561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:30.559960 9561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:40:30.565951 9561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:30.567180 9561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:30.568403 9561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:30.578931 9566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:30.578940 9570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:30.578940 9567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:30.579002 9561 server_base.cc:1034] running on GCE node
I20260807 22:40:30.579646 9561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:30.580430 9561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:30.581655 9561 hybrid_clock.cc:648] HybridClock initialized: now 1786142430581624 us; error 56 us; skew 500 ppm
Aug 07 22:40:30 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142430, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:30.584642 9561 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:40:30.585650 9561 webserver.cc:460] Webserver started at http://127.26.52.67:37003/ using document root <none> and password file <none>
I20260807 22:40:30.586279 9561 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:30.586375 9561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:30.586665 9561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:30.589238 9561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "d6f9127de2a044f9ae53c273168372ad"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "80d2abd560d53b4078257cb53b854d2e"
server_key_iv: "3b48f1fa0044a4a34a31499019f67033"
server_key_version: "encryptionkey@0"
I20260807 22:40:30.589872 9561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "d6f9127de2a044f9ae53c273168372ad"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "80d2abd560d53b4078257cb53b854d2e"
server_key_iv: "3b48f1fa0044a4a34a31499019f67033"
server_key_version: "encryptionkey@0"
I20260807 22:40:30.594168 9561 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 22:40:30.597010 9580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.598363 9561 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:40:30.598529 9561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "d6f9127de2a044f9ae53c273168372ad"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "80d2abd560d53b4078257cb53b854d2e"
server_key_iv: "3b48f1fa0044a4a34a31499019f67033"
server_key_version: "encryptionkey@0"
I20260807 22:40:30.598687 9561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:30.609742 9561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:30.613408 9561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:30.613653 9561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:30.614317 9561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:30.615236 9561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:30.615309 9561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.615388 9561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:30.615440 9561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.625056 9561 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:39421
I20260807 22:40:30.625084 9697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:39421 every 8 connection(s)
I20260807 22:40:30.626156 9561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:30.633821 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 9561
I20260807 22:40:30.633967 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:30.634358 26833 external_mini_cluster.cc:1428] Setting key aaf881ff4aff116a520f569f11af6704
Aug 07 22:40:30 dist-test-slave-8w9v krb5kdc[9158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142430, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:30.644148 9245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.628214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:40169 (local address 127.26.52.126:37263)
0807 22:40:30.628403 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.628408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.629377 (+ 969us) server_negotiation.cc:407] Connection header received
0807 22:40:30.630831 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.630834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.630888 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.630978 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:30.632785 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.633752 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.635887 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.636190 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.636339 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.640277 (+ 3938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:30.640280 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:30.640283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:30.640315 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:30.641962 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:30.642527 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:30.642530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:30.642532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:30.642615 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:30.642966 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:30.642969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:30.642971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:30.643163 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:30.643272 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.643790 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.643919 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:40:30.644984 9700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.628670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:40169)
0807 22:40:30.629202 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:30.629250 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:30.630605 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:30.631174 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:30.631181 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:30.631763 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:30.632554 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.632578 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.633995 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.634000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.635745 (+ 1745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.635760 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.637007 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.637011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.637272 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.638061 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:30.638086 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:30.640077 (+ 1991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:30.642117 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:30.642124 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:30.642141 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:30.642410 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:30.642712 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:30.642715 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:30.642717 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:30.642858 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:30.643272 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:30.643280 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:30.643546 (+ 266us) client_negotiation.cc:769] Sending connection context
0807 22:40:30.643732 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 22:40:30.644089 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":134,"threads_started":1}
I20260807 22:40:30.646190 9698 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37263
I20260807 22:40:30.646464 9698 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:30.646978 9698 heartbeater.cc:511] Master 127.26.52.126:37263 requested a full tablet report, sending...
I20260807 22:40:30.648149 9205 ts_manager.cc:194] Registered new tserver with Master: d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421)
I20260807 22:40:30.649080 9205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:40169
I20260807 22:40:30.651197 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:40:30.661944 9245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.653315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56264 (local address 127.26.52.126:37263)
0807 22:40:30.653477 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.653484 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.653589 (+ 105us) server_negotiation.cc:407] Connection header received
0807 22:40:30.653686 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.653691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.653747 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.653850 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:30.654514 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.655451 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.656357 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.656793 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.656926 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.658255 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:30.658261 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:30.658267 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:30.658299 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:30.660050 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:30.660492 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:30.660498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:30.660502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:30.660612 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:30.660884 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:30.660888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:30.660892 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:30.661236 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:30.661408 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.661568 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.661706 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:40:30.665038 9205 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56264:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:30.668453 9205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:30.685900 9715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.678139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:39421 (local address 127.0.0.1:50108)
0807 22:40:30.679660 (+ 1521us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:30.679721 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:30.679868 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:30.680576 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:30.680582 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:30.680605 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:30.680720 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.680725 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.682504 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.682511 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.683918 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.683941 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.685318 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.685322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.685431 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.685467 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 22:40:30.685585 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 22:40:30.685719 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1308,"thread_start_us":101,"threads_started":1}
I20260807 22:40:30.686825 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.678270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50108 (local address 127.26.52.67:39421)
0807 22:40:30.679639 (+ 1369us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.679657 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.679812 (+ 155us) server_negotiation.cc:407] Connection header received
0807 22:40:30.680065 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.680074 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.680384 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.680584 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:30.680808 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.682345 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.684082 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.684996 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.685107 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.685255 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.686551 (+ 1296us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.686662 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1206,"thread_start_us":126,"threads_started":1}
I20260807 22:40:30.689292 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.678892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:34069 (local address 127.0.0.1:33584)
0807 22:40:30.683250 (+ 4358us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:30.683265 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:30.683356 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:30.684240 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:30.684243 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:30.684260 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:30.684345 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.684351 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.686450 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.686453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.687595 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.687606 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.688883 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.688887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.688976 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.689001 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:40:30.689077 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:40:30.689150 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4286,"mutex_wait_us":1,"thread_start_us":145,"threads_started":1}
I20260807 22:40:30.689997 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.678752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:37629 (local address 127.0.0.1:59450)
0807 22:40:30.679934 (+ 1182us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:30.679952 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:30.682647 (+ 2695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:30.683605 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:30.683611 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:30.683637 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:30.683823 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.683833 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.685715 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.685721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.687482 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.687496 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.689329 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.689335 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.689510 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.689554 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 22:40:30.689645 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 22:40:30.689764 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1004,"mutex_wait_us":87,"thread_start_us":111,"threads_started":1}
I20260807 22:40:30.690670 9716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.679034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33584 (local address 127.26.52.65:34069)
0807 22:40:30.680291 (+ 1257us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.680305 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.683475 (+ 3170us) server_negotiation.cc:407] Connection header received
0807 22:40:30.683558 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.683563 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.683917 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.684062 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:30.684483 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.685515 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.687744 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.688564 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.688672 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.688813 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.690406 (+ 1593us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.690530 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1054,"thread_start_us":98,"threads_started":1}
I20260807 22:40:30.690759 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.679449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59450 (local address 127.26.52.66:37629)
0807 22:40:30.680345 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.680369 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.682796 (+ 2427us) server_negotiation.cc:407] Connection header received
0807 22:40:30.682907 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.682916 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.683184 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.683365 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:30.683988 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.685505 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.687664 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.688907 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.689053 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.689245 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.690348 (+ 1103us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.690496 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":797,"thread_start_us":97,"threads_started":1}
I20260807 22:40:30.690423 9630 tablet_service.cc:1467] Processing CreateTablet for tablet aba40440b01447da818004c9fa433680 (DEFAULT_TABLE table=test-table [id=607602aea73e49e3afd205cbee28fb8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:30.691951 9630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aba40440b01447da818004c9fa433680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:30.694002 9487 tablet_service.cc:1467] Processing CreateTablet for tablet aba40440b01447da818004c9fa433680 (DEFAULT_TABLE table=test-table [id=607602aea73e49e3afd205cbee28fb8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:30.694254 9338 tablet_service.cc:1467] Processing CreateTablet for tablet aba40440b01447da818004c9fa433680 (DEFAULT_TABLE table=test-table [id=607602aea73e49e3afd205cbee28fb8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:30.695170 9487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aba40440b01447da818004c9fa433680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:30.695535 9338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aba40440b01447da818004c9fa433680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:30.703873 9720 tablet_bootstrap.cc:492] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: Bootstrap starting.
I20260807 22:40:30.704674 9719 tablet_bootstrap.cc:492] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: Bootstrap starting.
I20260807 22:40:30.706758 9721 tablet_bootstrap.cc:492] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Bootstrap starting.
I20260807 22:40:30.706882 9719 tablet_bootstrap.cc:654] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:30.708176 9720 tablet_bootstrap.cc:654] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:30.708518 9719 log.cc:824] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:30.709115 9720 log.cc:824] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:30.709638 9721 tablet_bootstrap.cc:654] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:30.710631 9721 log.cc:824] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:30.710712 9719 tablet_bootstrap.cc:492] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: No bootstrap required, opened a new log
I20260807 22:40:30.710929 9719 ts_tablet_manager.cc:1397] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 22:40:30.713016 9721 tablet_bootstrap.cc:492] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: No bootstrap required, opened a new log
I20260807 22:40:30.713251 9721 ts_tablet_manager.cc:1397] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:40:30.714509 9719 raft_consensus.cc:348] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:30.714784 9719 raft_consensus.cc:374] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:30.714838 9719 raft_consensus.cc:729] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6f9127de2a044f9ae53c273168372ad, State: Initialized, Role: FOLLOWER
I20260807 22:40:30.715281 9719 consensus_queue.cc:260] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:30.715978 9698 heartbeater.cc:503] Master 127.26.52.126:37263 was elected leader, sending a full tablet report...
I20260807 22:40:30.717829 9720 tablet_bootstrap.cc:492] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: No bootstrap required, opened a new log
I20260807 22:40:30.718062 9720 ts_tablet_manager.cc:1397] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260807 22:40:30.720326 9719 ts_tablet_manager.cc:1428] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 22:40:30.720238 9721 raft_consensus.cc:348] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:30.720606 9721 raft_consensus.cc:374] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:30.720666 9721 raft_consensus.cc:729] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b432d90e46b43bc92c6f8e5a5068d8c, State: Initialized, Role: FOLLOWER
I20260807 22:40:30.721354 9721 consensus_queue.cc:260] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:30.722654 9721 ts_tablet_manager.cc:1428] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260807 22:40:30.722780 9411 heartbeater.cc:503] Master 127.26.52.126:37263 was elected leader, sending a full tablet report...
I20260807 22:40:30.722692 9720 raft_consensus.cc:348] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:30.723116 9720 raft_consensus.cc:374] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:30.723194 9720 raft_consensus.cc:729] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c7e381e5654c4598623bee79542171, State: Initialized, Role: FOLLOWER
I20260807 22:40:30.723662 9720 consensus_queue.cc:260] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:30.724664 9554 heartbeater.cc:503] Master 127.26.52.126:37263 was elected leader, sending a full tablet report...
I20260807 22:40:30.724812 9720 ts_tablet_manager.cc:1428] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260807 22:40:30.725106 9725 raft_consensus.cc:482] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:30.725286 9725 raft_consensus.cc:504] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:30.726567 9725 leader_election.cc:288] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b432d90e46b43bc92c6f8e5a5068d8c (127.26.52.65:34069), 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629)
I20260807 22:40:30.730852 9716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.726865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:37485 (local address 127.26.52.65:34069)
0807 22:40:30.726974 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.726980 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.727167 (+ 187us) server_negotiation.cc:407] Connection header received
0807 22:40:30.727219 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.727222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.727277 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.727352 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:30.727760 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.728488 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.729833 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.730279 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.730415 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.730480 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.730656 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.730728 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:40:30.730852 9700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.726776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:34069 (local address 127.26.52.67:37485)
0807 22:40:30.726966 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:30.726982 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:30.727075 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:30.727481 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:30.727486 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:30.727507 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:30.727651 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.727660 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.728604 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.728610 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.729698 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.729708 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.730407 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.730411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.730523 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.730549 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:40:30.730640 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 22:40:30.730718 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260807 22:40:30.731498 9361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aba40440b01447da818004c9fa433680" candidate_uuid: "d6f9127de2a044f9ae53c273168372ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" is_pre_election: true
I20260807 22:40:30.731812 9361 raft_consensus.cc:2454] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6f9127de2a044f9ae53c273168372ad in term 0.
I20260807 22:40:30.732318 9583 leader_election.cc:302] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b432d90e46b43bc92c6f8e5a5068d8c, d6f9127de2a044f9ae53c273168372ad; no voters:
I20260807 22:40:30.732975 9725 raft_consensus.cc:2781] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:30.733076 9725 raft_consensus.cc:482] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:30.733130 9725 raft_consensus.cc:3037] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:30.734484 9725 raft_consensus.cc:504] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:30.734884 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.728034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:43111 (local address 127.26.52.66:37629)
0807 22:40:30.728342 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.728349 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.728367 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:40:30.728421 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.728426 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.728492 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.728583 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:30.729405 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.730392 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.732921 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.733826 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.733956 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.734041 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.734562 (+ 521us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.734683 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204}
I20260807 22:40:30.734961 9725 leader_election.cc:288] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [CANDIDATE]: Term 1 election: Requested vote from peers 6b432d90e46b43bc92c6f8e5a5068d8c (127.26.52.65:34069), 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629)
I20260807 22:40:30.735229 9361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aba40440b01447da818004c9fa433680" candidate_uuid: "d6f9127de2a044f9ae53c273168372ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c"
I20260807 22:40:30.735410 9361 raft_consensus.cc:3037] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:30.735507 9729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.727176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:37629 (local address 127.26.52.67:43111)
0807 22:40:30.728146 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:30.728161 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:30.728243 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:30.728989 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:30.728995 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:30.729027 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:30.729210 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.729219 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.730998 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.731005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.732732 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:30.732751 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.734193 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.734199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:30.734370 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.734413 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 22:40:30.735122 (+ 709us) client_negotiation.cc:240] Negotiation successful
0807 22:40:30.735265 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"thread_start_us":127,"threads_started":1}
I20260807 22:40:30.736279 9507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aba40440b01447da818004c9fa433680" candidate_uuid: "d6f9127de2a044f9ae53c273168372ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c7e381e5654c4598623bee79542171" is_pre_election: true
I20260807 22:40:30.736366 9506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aba40440b01447da818004c9fa433680" candidate_uuid: "d6f9127de2a044f9ae53c273168372ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c7e381e5654c4598623bee79542171"
I20260807 22:40:30.736624 9507 raft_consensus.cc:2454] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6f9127de2a044f9ae53c273168372ad in term 0.
I20260807 22:40:30.736888 9361 raft_consensus.cc:2454] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6f9127de2a044f9ae53c273168372ad in term 1.
I20260807 22:40:30.737180 9583 leader_election.cc:302] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b432d90e46b43bc92c6f8e5a5068d8c, d6f9127de2a044f9ae53c273168372ad; no voters:
I20260807 22:40:30.737378 9725 raft_consensus.cc:2781] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:30.737664 9725 raft_consensus.cc:686] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 1 LEADER]: Becoming Leader. State: Replica: d6f9127de2a044f9ae53c273168372ad, State: Running, Role: LEADER
I20260807 22:40:30.738029 9725 consensus_queue.cc:237] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:30.741945 9205 catalog_manager.cc:5495] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad reported cstate change: term changed from 0 to 1, leader changed from <none> to d6f9127de2a044f9ae53c273168372ad (127.26.52.67). New cstate: current_term: 1 leader_uuid: "d6f9127de2a044f9ae53c273168372ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:30.755831 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.751382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50116 (local address 127.26.52.67:39421)
0807 22:40:30.751543 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.751547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.751563 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:40:30.751721 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.751724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.751780 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.751895 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:30.752190 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.752726 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.753618 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.754115 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.754275 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.754545 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:30.755275 (+ 730us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:30.755437 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.755525 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.755611 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 22:40:30.763504 9506 raft_consensus.cc:3037] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:30.763723 9361 raft_consensus.cc:1261] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Refusing update from remote peer d6f9127de2a044f9ae53c273168372ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:30.764632 9725 consensus_queue.cc:1035] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:30.765364 9506 raft_consensus.cc:1261] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171 [term 1 FOLLOWER]: Refusing update from remote peer d6f9127de2a044f9ae53c273168372ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:30.766096 9725 consensus_queue.cc:1035] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:30.779843 9737 mvcc.cc:205] Tried to move back new op lower bound from 7316039396399534080 to 7316039396306108416. Current Snapshot: MvccSnapshot[applied={T|T < 7316039396399534080}]
I20260807 22:40:30.781701 9734 mvcc.cc:205] Tried to move back new op lower bound from 7316039396399534080 to 7316039396306108416. Current Snapshot: MvccSnapshot[applied={T|T < 7316039396399534080}]
I20260807 22:40:30.786188 9205 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56264:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:30.786468 9205 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56264:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:30.789921 9205 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Sending DeleteTablet for 3 replicas of tablet aba40440b01447da818004c9fa433680
I20260807 22:40:30.790934 9630 tablet_service.cc:1514] Processing DeleteTablet for tablet aba40440b01447da818004c9fa433680 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:30 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:50108
I20260807 22:40:30.791007 9338 tablet_service.cc:1514] Processing DeleteTablet for tablet aba40440b01447da818004c9fa433680 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:30 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:33584
I20260807 22:40:30.792126 9487 tablet_service.cc:1514] Processing DeleteTablet for tablet aba40440b01447da818004c9fa433680 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:30 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:59450
I20260807 22:40:30.792284 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 9271
I20260807 22:40:30.794189 9747 tablet_replica.cc:330] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: stopping tablet replica
I20260807 22:40:30.794600 9747 raft_consensus.cc:2229] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:30.794981 9747 raft_consensus.cc:2258] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:30.797034 9744 tablet_replica.cc:330] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: stopping tablet replica
I20260807 22:40:30.797773 9747 ts_tablet_manager.cc:1905] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:30.798336 9744 raft_consensus.cc:2229] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:30.800992 9747 ts_tablet_manager.cc:1918] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:30.801115 9747 log.cc:1196] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/aba40440b01447da818004c9fa433680
I20260807 22:40:30.801478 9747 ts_tablet_manager.cc:1939] T aba40440b01447da818004c9fa433680 P 14c7e381e5654c4598623bee79542171: Deleting consensus metadata
I20260807 22:40:30.801892 9744 raft_consensus.cc:2258] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:30.804036 9744 ts_tablet_manager.cc:1905] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:30.806867 9744 ts_tablet_manager.cc:1918] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:30.806995 9744 log.cc:1196] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/aba40440b01447da818004c9fa433680
I20260807 22:40:30.807332 9744 ts_tablet_manager.cc:1939] T aba40440b01447da818004c9fa433680 P d6f9127de2a044f9ae53c273168372ad: Deleting consensus metadata
W20260807 22:40:30.808053 9191 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:34069 (error 108)
I20260807 22:40:30.809185 9192 catalog_manager.cc:4841] TS 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629): tablet aba40440b01447da818004c9fa433680 (table test-table [id=607602aea73e49e3afd205cbee28fb8a]) successfully deleted
I20260807 22:40:30.809391 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 9416
I20260807 22:40:30.813180 9190 catalog_manager.cc:4841] TS d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421): tablet aba40440b01447da818004c9fa433680 (table test-table [id=607602aea73e49e3afd205cbee28fb8a]) successfully deleted
I20260807 22:40:30.821485 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.821031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:34069 (local address 127.0.0.1:33600)
0807 22:40:30.821227 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:30.821341 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:34069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 22:40:30.821751 9191 catalog_manager.cc:4584] TS 6b432d90e46b43bc92c6f8e5a5068d8c (127.26.52.65:34069): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aba40440b01447da818004c9fa433680: Network error: Client connection negotiation failed: client connection to 127.26.52.65:34069: connect: Connection refused (error 111)
I20260807 22:40:30.823786 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 9561
I20260807 22:40:30.832964 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 9172
I20260807 22:40:30.842193 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37263
--webserver_interface=127.26.52.126
--webserver_port=34899
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:37263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:30.962143 9750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:30.962496 9750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:30.962582 9750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:30.966979 9750 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:30.967084 9750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:30.967121 9750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:30.967159 9750 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:30.967217 9750 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:30.973083 9750 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:37263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=34899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:30.974370 9750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:30.975494 9750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:30.990600 9757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:30.990578 9750 server_base.cc:1034] running on GCE node
W20260807 22:40:30.990563 9756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:30.990574 9759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:30.991474 9750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:30.992874 9750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:30.994072 9750 hybrid_clock.cc:648] HybridClock initialized: now 1786142430994039 us; error 52 us; skew 500 ppm
Aug 07 22:40:30 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142430, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:30.997093 9750 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:40:30.998153 9750 webserver.cc:460] Webserver started at http://127.26.52.126:34899/ using document root <none> and password file <none>
I20260807 22:40:30.998811 9750 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:30.998932 9750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:31.003305 9750 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:31.005736 9767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:31.007051 9750 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:40:31.007217 9750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "be6ca3b137bd4028898e3c85a7a2d3d1"
format_stamp: "Formatted at 2026-08-07 22:40:29 on dist-test-slave-8w9v"
server_key: "539ea1743bacc4d5728a0d87139929b7"
server_key_iv: "2b0f1baf65092098cf599decb92f5c91"
server_key_version: "encryptionkey@0"
I20260807 22:40:31.007893 9750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:31.020000 9750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:31.023121 9750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:31.023365 9750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:31.031363 9750 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:37263
I20260807 22:40:31.031682 9821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:37263 every 8 connection(s)
I20260807 22:40:31.032743 9750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:31.037675 9822 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:40:31.039448 9822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Bootstrap starting.
I20260807 22:40:31.040462 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 9750
I20260807 22:40:31.040920 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:34069
--local_ip_for_outbound_sockets=127.26.52.65
--tserver_master_addrs=127.26.52.126:37263
--webserver_port=44667
--webserver_interface=127.26.52.65
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:40:31.057801 9822 log.cc:824] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:31.067492 9822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:40:31.067931 9822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Bootstrap complete.
I20260807 22:40:31.072407 9822 raft_consensus.cc:348] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:31.072909 9822 raft_consensus.cc:729] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: be6ca3b137bd4028898e3c85a7a2d3d1, State: Initialized, Role: FOLLOWER
I20260807 22:40:31.073447 9822 consensus_queue.cc:260] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:31.073599 9822 raft_consensus.cc:388] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:31.073694 9822 raft_consensus.cc:482] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:31.073822 9822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:40:31.075944 9822 raft_consensus.cc:504] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:31.076403 9822 leader_election.cc:302] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be6ca3b137bd4028898e3c85a7a2d3d1; no voters:
I20260807 22:40:31.076778 9822 leader_election.cc:288] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:40:31.076918 9827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:40:31.077195 9827 raft_consensus.cc:686] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 2 LEADER]: Becoming Leader. State: Replica: be6ca3b137bd4028898e3c85a7a2d3d1, State: Running, Role: LEADER
I20260807 22:40:31.077538 9827 consensus_queue.cc:237] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:31.078120 9822 sys_catalog.cc:564] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:31.079118 9828 sys_catalog.cc:455] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } } }
I20260807 22:40:31.079257 9828 sys_catalog.cc:458] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:31.079582 9829 sys_catalog.cc:455] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be6ca3b137bd4028898e3c85a7a2d3d1. Latest consensus state: current_term: 2 leader_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } } }
I20260807 22:40:31.079670 9829 sys_catalog.cc:458] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:31.080228 9836 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:31.085551 9836 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:31.086308 9836 catalog_manager.cc:1259] Loaded cluster ID: f32d6af287d244f19bcbb9a59fd7add6
I20260807 22:40:31.086387 9836 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:31.087944 9836 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 22:40:31.093027 9836 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 22:40:31.099457 9836 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:31.100525 9836 catalog_manager.cc:5879] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Loaded TSK: 0
I20260807 22:40:31.101822 9836 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:40:31.170394 9825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:31.170717 9825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:31.170800 9825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:31.175076 9825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:31.175189 9825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:31.175279 9825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:40:31.181311 9825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:34069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=44667
--tserver_master_addrs=127.26.52.126:37263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:31.182451 9825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:31.183571 9825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:31.194985 9853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:31.194993 9852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:31.195103 9855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:31.195511 9825 server_base.cc:1034] running on GCE node
I20260807 22:40:31.195992 9825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:31.196875 9825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:31.198073 9825 hybrid_clock.cc:648] HybridClock initialized: now 1786142431198043 us; error 39 us; skew 500 ppm
Aug 07 22:40:31 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142431, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:31.201313 9825 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:40:31.202291 9825 webserver.cc:460] Webserver started at http://127.26.52.65:44667/ using document root <none> and password file <none>
I20260807 22:40:31.202926 9825 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:31.203047 9825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:31.207455 9825 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:31.210136 9864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:31.211603 9825 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:31.211773 9825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "6b432d90e46b43bc92c6f8e5a5068d8c"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "96cd7c85ae8332220c4946795302cdc0"
server_key_iv: "efde409a55c69de652e12a0a55af302c"
server_key_version: "encryptionkey@0"
I20260807 22:40:31.212466 9825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:31.232317 9825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:31.236160 9825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:31.236429 9825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:31.237227 9825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:31.238672 9871 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:40:31.243292 9825 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:40:31.243369 9825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260807 22:40:31.243471 9825 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:40:31.245419 9825 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:40:31.245472 9825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260807 22:40:31.245791 9871 tablet_bootstrap.cc:492] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Bootstrap starting.
I20260807 22:40:31.257741 9825 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:34069
I20260807 22:40:31.257781 9986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:34069 every 8 connection(s)
I20260807 22:40:31.258891 9825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:31.259253 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 9825
I20260807 22:40:31.259735 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:37629
--local_ip_for_outbound_sockets=127.26.52.66
--tserver_master_addrs=127.26.52.126:37263
--webserver_port=35375
--webserver_interface=127.26.52.66
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:40:31.266518 9871 log.cc:824] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:31.271410 9871 tablet_bootstrap.cc:492] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
Aug 07 22:40:31 dist-test-slave-8w9v krb5kdc[9158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142431, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:31.272003 9871 tablet_bootstrap.cc:492] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Bootstrap complete.
I20260807 22:40:31.273669 9871 ts_tablet_manager.cc:1397] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Time spent bootstrapping tablet: real 0.028s user 0.022s sys 0.004s
I20260807 22:40:31.277966 9871 raft_consensus.cc:348] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:31.278942 9991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.261599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:35711)
0807 22:40:31.262508 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:31.262570 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:31.263545 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:31.264985 (+ 1440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:31.264994 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:31.265478 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:31.266084 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.266102 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.267934 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.267938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.268983 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.268995 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.269855 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.269859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.270062 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.270779 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:31.270798 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:31.272539 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:31.275003 (+ 2464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:31.275009 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:31.275024 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:31.275397 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:31.275952 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:31.275955 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:31.275956 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:31.276172 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:31.276867 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:31.276874 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:31.277167 (+ 293us) client_negotiation.cc:769] Sending connection context
0807 22:40:31.277370 (+ 203us) client_negotiation.cc:240] Negotiation successful
0807 22:40:31.277782 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":173,"threads_started":1}
I20260807 22:40:31.279001 9990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.261582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:35711 (local address 127.26.52.126:37263)
0807 22:40:31.262148 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.262171 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.262715 (+ 544us) server_negotiation.cc:407] Connection header received
0807 22:40:31.264110 (+ 1395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.264172 (+ 62us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.264532 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.264904 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:31.266294 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.267746 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.269132 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.269673 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.269904 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.272783 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:31.272790 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:31.272804 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:31.272837 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:31.274825 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:31.275560 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:31.275567 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:31.275573 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:31.275732 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:31.276303 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:31.276307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:31.276308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:31.276730 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:31.276899 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.277528 (+ 629us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.277835 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":132,"threads_started":1}
I20260807 22:40:31.280478 9871 raft_consensus.cc:729] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b432d90e46b43bc92c6f8e5a5068d8c, State: Initialized, Role: FOLLOWER
I20260807 22:40:31.282014 9871 consensus_queue.cc:260] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } }
I20260807 22:40:31.282444 9987 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37263
I20260807 22:40:31.282696 9987 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:31.283142 9871 ts_tablet_manager.cc:1428] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260807 22:40:31.283300 9987 heartbeater.cc:511] Master 127.26.52.126:37263 requested a full tablet report, sending...
I20260807 22:40:31.286151 9784 ts_manager.cc:194] Registered new tserver with Master: 6b432d90e46b43bc92c6f8e5a5068d8c (127.26.52.65:34069)
I20260807 22:40:31.290391 9784 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:35711
I20260807 22:40:31.293012 9987 heartbeater.cc:503] Master 127.26.52.126:37263 was elected leader, sending a full tablet report...
Aug 07 22:40:31 dist-test-slave-8w9v krb5kdc[9158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142430, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:40:31.303467 9998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.289886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33602 (local address 127.26.52.65:34069)
0807 22:40:31.290359 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.290373 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.290825 (+ 452us) server_negotiation.cc:407] Connection header received
0807 22:40:31.291078 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.291083 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.291315 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.291487 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:31.294003 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.294965 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.296266 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.296666 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.296757 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.299389 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:31.299399 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:31.299411 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:31.299440 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:31.301435 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:31.302008 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:31.302014 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:31.302015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:31.302096 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:31.302398 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:31.302400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:31.302401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:31.302663 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:31.302775 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.303172 (+ 397us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.303323 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":110,"threads_started":1}
I20260807 22:40:31.303500 9997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.289810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:34069 (local address 127.0.0.1:33602)
0807 22:40:31.290677 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:31.290716 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:31.290900 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:31.291491 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:31.291497 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:31.293670 (+ 2173us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:31.293832 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.293841 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.295097 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.295101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.296068 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.296081 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.296796 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.296800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.296914 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.297521 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:31.297536 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:31.299224 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:31.301560 (+ 2336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:31.301572 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:31.301578 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:31.301890 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:31.302193 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:31.302199 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:31.302203 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:31.302303 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:31.302790 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:31.302796 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:31.302938 (+ 142us) client_negotiation.cc:769] Sending connection context
0807 22:40:31.303093 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 22:40:31.303305 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":164,"threads_started":1}
I20260807 22:40:31.304795 9915 tablet_service.cc:1514] Processing DeleteTablet for tablet aba40440b01447da818004c9fa433680 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:30 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:33602
I20260807 22:40:31.305843 9999 tablet_replica.cc:330] stopping tablet replica
I20260807 22:40:31.306190 9999 raft_consensus.cc:2229] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:31.306483 9999 pending_rounds.cc:62] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Trying to abort 1 pending ops.
I20260807 22:40:31.306571 9999 pending_rounds.cc:68] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316039396399534080 op_type: WRITE_OP write_request { tablet_id: "aba40440b01447da818004c9fa433680" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\212\300\331\323\006\"8\n\ntest-admin\022*\n 607602aea73e49e3afd205cbee28fb8a\020\001\030\001 \001(\001" signature: "<redacted>""\330a8\200\210\360x\245\220\007\370\321\236d\036\310^5+\334\256\023I\021l\202\330\005\262\311O2,\3748I\211\026\371\307\317h\326\\=2Q+\261\354\327sm\200*\370D\361-,f\330\340\212" signing_key_seq_num: 0 } } request_id { client_id: "0d95dd47d2af41e0b56489892823af81" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260807 22:40:31.307441 9999 raft_consensus.cc:2258] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:31.308559 9999 ts_tablet_manager.cc:1905] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:31.315085 9999 ts_tablet_manager.cc:1918] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:31.315200 9999 log.cc:1196] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/aba40440b01447da818004c9fa433680
I20260807 22:40:31.315594 9999 ts_tablet_manager.cc:1939] T aba40440b01447da818004c9fa433680 P 6b432d90e46b43bc92c6f8e5a5068d8c: Deleting consensus metadata
I20260807 22:40:31.317766 9770 catalog_manager.cc:4841] TS 6b432d90e46b43bc92c6f8e5a5068d8c (127.26.52.65:34069): tablet aba40440b01447da818004c9fa433680 (table test-table [id=607602aea73e49e3afd205cbee28fb8a]) successfully deleted
W20260807 22:40:31.392066 9989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:31.392441 9989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:31.392524 9989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:31.396731 9989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:31.396806 9989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:31.396936 9989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:40:31.402808 9989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:37629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=35375
--tserver_master_addrs=127.26.52.126:37263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:31.404042 9989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:31.405177 9989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:31.416508 10004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:31.416555 9989 server_base.cc:1034] running on GCE node
W20260807 22:40:31.416757 10007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:31.416765 10005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:31.417281 9989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:31.418042 9989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:31.419250 9989 hybrid_clock.cc:648] HybridClock initialized: now 1786142431419236 us; error 27 us; skew 500 ppm
Aug 07 22:40:31 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142431, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:31.422308 9989 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:40:31.423323 9989 webserver.cc:460] Webserver started at http://127.26.52.66:35375/ using document root <none> and password file <none>
I20260807 22:40:31.423974 9989 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:31.424093 9989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:31.428409 9989 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 22:40:31.430927 10014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:31.432440 9989 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:31.432605 9989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "14c7e381e5654c4598623bee79542171"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "8f5da6782ac2e0dbf877a42e9ffd71c9"
server_key_iv: "fdcf7582d38e2f28ab98373bd4a066e6"
server_key_version: "encryptionkey@0"
I20260807 22:40:31.433245 9989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:31.467998 9989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:31.471851 9989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:31.472090 9989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:31.472800 9989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:31.473742 9989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:31.473822 9989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:31.473904 9989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:31.473946 9989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:31.483906 9989 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:37629
I20260807 22:40:31.483930 10138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:37629 every 8 connection(s)
I20260807 22:40:31.485122 9989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:31.489871 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 9989
I20260807 22:40:31.490406 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:39421
--local_ip_for_outbound_sockets=127.26.52.67
--tserver_master_addrs=127.26.52.126:37263
--webserver_port=37003
--webserver_interface=127.26.52.67
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:40:31 dist-test-slave-8w9v krb5kdc[9158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142431, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:31.502283 9990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.487192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:60009 (local address 127.26.52.126:37263)
0807 22:40:31.487366 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.487371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.488382 (+ 1011us) server_negotiation.cc:407] Connection header received
0807 22:40:31.489892 (+ 1510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.489896 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.489970 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.490069 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:31.491818 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.492718 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.493910 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.494408 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.494553 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.497326 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:31.497334 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:31.497340 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:31.497387 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:31.499422 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:31.500090 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:31.500098 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:31.500101 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:31.500235 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:31.500667 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:31.500674 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:31.500678 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:31.501019 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:31.501156 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.501808 (+ 652us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.502003 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:40:31.503170 10143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.487652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:60009)
0807 22:40:31.488217 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:31.488266 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:31.489644 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:31.490293 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:31.490306 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:31.490860 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:31.491629 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.491653 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.492869 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.492872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.493773 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.493782 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.494588 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.494591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.494750 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.495451 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:31.495480 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:31.497089 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:31.499592 (+ 2503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:31.499598 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:31.499615 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:31.499961 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:31.500372 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:31.500376 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:31.500378 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:31.500553 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:31.501155 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:31.501161 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:31.501506 (+ 345us) client_negotiation.cc:769] Sending connection context
0807 22:40:31.501710 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 22:40:31.502028 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":129,"threads_started":1}
I20260807 22:40:31.504649 10139 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37263
I20260807 22:40:31.504944 10139 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:31.505595 10139 heartbeater.cc:511] Master 127.26.52.126:37263 requested a full tablet report, sending...
I20260807 22:40:31.506892 9784 ts_manager.cc:194] Registered new tserver with Master: 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629)
I20260807 22:40:31.507543 9784 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:60009
W20260807 22:40:31.618201 10144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:31.618499 10144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:31.618584 10144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:31.622854 10144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:31.622942 10144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:31.623047 10144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:40:31.629002 10144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:39421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=37003
--tserver_master_addrs=127.26.52.126:37263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:31.630245 10144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:31.631367 10144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:31.642241 10150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:31.642241 10152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:31.642247 10149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:31.642714 10144 server_base.cc:1034] running on GCE node
I20260807 22:40:31.643210 10144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:31.643908 10144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:31.645079 10144 hybrid_clock.cc:648] HybridClock initialized: now 1786142431645065 us; error 44 us; skew 500 ppm
Aug 07 22:40:31 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142431, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:31.648356 10144 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:40:31.649432 10144 webserver.cc:460] Webserver started at http://127.26.52.67:37003/ using document root <none> and password file <none>
I20260807 22:40:31.650101 10144 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:31.650188 10144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:31.654883 10144 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:40:31.657371 10159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:31.658752 10144 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:31.658924 10144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "d6f9127de2a044f9ae53c273168372ad"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "80d2abd560d53b4078257cb53b854d2e"
server_key_iv: "3b48f1fa0044a4a34a31499019f67033"
server_key_version: "encryptionkey@0"
I20260807 22:40:31.659549 10144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:31.707609 10144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:31.711674 10144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:31.711915 10144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:31.712674 10144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:31.713567 10144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:31.713618 10144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:31.713660 10144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:31.713709 10144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:31.723855 10144 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:39421
I20260807 22:40:31.723879 10282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:39421 every 8 connection(s)
I20260807 22:40:31.725122 10144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:31.730194 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 10144
Aug 07 22:40:31 dist-test-slave-8w9v krb5kdc[9158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142431, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:31.740062 10287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.731027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56268 (local address 127.26.52.126:37263)
0807 22:40:31.731290 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.731295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.731408 (+ 113us) server_negotiation.cc:407] Connection header received
0807 22:40:31.731517 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.731520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.731570 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.731679 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:31.732519 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.733044 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.733956 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.734308 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.734419 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.736265 (+ 1846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:31.736268 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:31.736270 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:31.736320 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:31.738067 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:31.738643 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:31.738650 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:31.738654 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:31.738756 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:31.739101 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:31.739106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:31.739110 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:31.739318 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:31.739553 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.739721 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.739854 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":183,"thread_start_us":74,"threads_started":1}
I20260807 22:40:31.741714 9990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.727332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:40295 (local address 127.26.52.126:37263)
0807 22:40:31.727494 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.727498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.728496 (+ 998us) server_negotiation.cc:407] Connection header received
0807 22:40:31.730100 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.730103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.730159 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.730246 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:31.731956 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.732583 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.733870 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.734191 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.734332 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.737529 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:31.737533 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:31.737535 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:31.737579 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:31.739265 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:31.739801 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:31.739805 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:31.739807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:31.739890 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:31.740396 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:31.740400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:31.740401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:31.740632 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:31.740731 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.741453 (+ 722us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.741570 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":62}
I20260807 22:40:31.742712 10285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.727742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:40295)
0807 22:40:31.728322 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:31.728372 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:31.729671 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:31.730500 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:31.730510 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:31.731003 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:31.731806 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.731824 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.732724 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.732728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.733716 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.733727 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.734403 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.734408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.734585 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.735333 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:31.735350 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:31.737348 (+ 1998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:31.739385 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:31.739391 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:31.739410 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:31.739685 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:31.740027 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:31.740030 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:31.740032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:31.740282 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:31.740752 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:31.740759 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:31.741111 (+ 352us) client_negotiation.cc:769] Sending connection context
0807 22:40:31.741358 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 22:40:31.741679 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":139,"threads_started":1}
I20260807 22:40:31.743857 10283 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37263
I20260807 22:40:31.744107 10283 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:31.744647 10283 heartbeater.cc:511] Master 127.26.52.126:37263 requested a full tablet report, sending...
I20260807 22:40:31.745848 9784 ts_manager.cc:194] Registered new tserver with Master: d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421)
I20260807 22:40:31.746732 9784 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:40295
I20260807 22:40:31.754992 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:40:31.759907 9990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.755727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56278 (local address 127.26.52.126:37263)
0807 22:40:31.755900 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.755907 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.756266 (+ 359us) server_negotiation.cc:407] Connection header received
0807 22:40:31.756472 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.756475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.756591 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.756691 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:31.756956 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.757498 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.758363 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.758573 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.758653 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.759036 (+ 383us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:31.759512 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:31.759608 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.759729 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.759782 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:40:31.760692 9784 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:56278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:31.764410 9784 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:31.773207 9915 tablet_service.cc:1467] Processing CreateTablet for tablet 3b56e8dd33cf45f0b88b348d55c0eb92 (DEFAULT_TABLE table=test-table [id=33c76d9f49624f8db43775d30f2c0d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:31.773958 9915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56e8dd33cf45f0b88b348d55c0eb92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:31.777051 9871 tablet_bootstrap.cc:492] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: Bootstrap starting.
I20260807 22:40:31.778023 9871 tablet_bootstrap.cc:654] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:31.778803 10292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.772307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:37629 (local address 127.0.0.1:59456)
0807 22:40:31.772714 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:31.772728 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:31.772839 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:31.773557 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:31.773560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:31.773595 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:31.773922 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.773931 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.775300 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.775305 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.777014 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.777028 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.778192 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.778196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.778328 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.778411 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 22:40:31.778502 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 22:40:31.778630 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":317,"thread_start_us":145,"threads_started":1}
I20260807 22:40:31.779104 10293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.772629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59456 (local address 127.26.52.66:37629)
0807 22:40:31.773088 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.773098 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.773119 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:40:31.773186 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.773191 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.773367 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.774081 (+ 714us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:31.774260 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.775147 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.777175 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.778030 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.778161 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.778313 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.778552 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.778710 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":188,"threads_started":1}
I20260807 22:40:31.779637 9871 tablet_bootstrap.cc:492] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: No bootstrap required, opened a new log
I20260807 22:40:31.779757 9871 ts_tablet_manager.cc:1397] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:31.779886 9997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.772018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:39421 (local address 127.0.0.1:50124)
0807 22:40:31.772189 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:31.772213 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:31.772321 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:31.773665 (+ 1344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:31.773667 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:31.773680 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:31.773767 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.773773 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.775314 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.775318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.777014 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.777028 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.779466 (+ 2438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.779470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.779574 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.779598 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:40:31.779651 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:40:31.779765 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":222}
I20260807 22:40:31.780395 9871 raft_consensus.cc:348] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:31.780532 9871 raft_consensus.cc:374] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:31.780580 9871 raft_consensus.cc:729] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b432d90e46b43bc92c6f8e5a5068d8c, State: Initialized, Role: FOLLOWER
I20260807 22:40:31.780722 9871 consensus_queue.cc:260] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:31.781015 9871 ts_tablet_manager.cc:1428] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:31.781401 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.772680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50124 (local address 127.26.52.67:39421)
0807 22:40:31.773196 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.773209 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.773236 (+ 27us) server_negotiation.cc:407] Connection header received
0807 22:40:31.773319 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.773325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.773526 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.773710 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:31.773879 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.775147 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.778375 (+ 3228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.779277 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.780369 (+ 1092us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.780570 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.780626 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.780721 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":183,"threads_started":1}
I20260807 22:40:31.782825 10067 tablet_service.cc:1467] Processing CreateTablet for tablet 3b56e8dd33cf45f0b88b348d55c0eb92 (DEFAULT_TABLE table=test-table [id=33c76d9f49624f8db43775d30f2c0d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:31.784057 10067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56e8dd33cf45f0b88b348d55c0eb92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:31.784291 10210 tablet_service.cc:1467] Processing CreateTablet for tablet 3b56e8dd33cf45f0b88b348d55c0eb92 (DEFAULT_TABLE table=test-table [id=33c76d9f49624f8db43775d30f2c0d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:31.785364 10210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56e8dd33cf45f0b88b348d55c0eb92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:31.793390 10296 tablet_bootstrap.cc:492] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: Bootstrap starting.
I20260807 22:40:31.793964 10297 tablet_bootstrap.cc:492] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: Bootstrap starting.
I20260807 22:40:31.796552 10296 tablet_bootstrap.cc:654] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:31.797148 10297 tablet_bootstrap.cc:654] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:31.798130 10296 log.cc:824] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:31.798130 10297 log.cc:824] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:31.800572 10296 tablet_bootstrap.cc:492] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: No bootstrap required, opened a new log
I20260807 22:40:31.800827 10296 ts_tablet_manager.cc:1397] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 22:40:31.801586 10297 tablet_bootstrap.cc:492] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: No bootstrap required, opened a new log
I20260807 22:40:31.801813 10297 ts_tablet_manager.cc:1397] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 22:40:31.805424 10296 raft_consensus.cc:348] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:31.805840 10296 raft_consensus.cc:374] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:31.805936 10296 raft_consensus.cc:729] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6f9127de2a044f9ae53c273168372ad, State: Initialized, Role: FOLLOWER
I20260807 22:40:31.805943 10297 raft_consensus.cc:348] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:31.806210 10297 raft_consensus.cc:374] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:31.806288 10297 raft_consensus.cc:729] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c7e381e5654c4598623bee79542171, State: Initialized, Role: FOLLOWER
I20260807 22:40:31.806495 10296 consensus_queue.cc:260] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:31.806689 10297 consensus_queue.cc:260] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:31.807369 10283 heartbeater.cc:503] Master 127.26.52.126:37263 was elected leader, sending a full tablet report...
I20260807 22:40:31.807369 10139 heartbeater.cc:503] Master 127.26.52.126:37263 was elected leader, sending a full tablet report...
I20260807 22:40:31.807773 10297 ts_tablet_manager.cc:1428] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:40:31.807773 10296 ts_tablet_manager.cc:1428] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 22:40:31.877013 10300 raft_consensus.cc:482] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:31.877269 10300 raft_consensus.cc:504] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:31.878677 10300 leader_election.cc:288] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629), 6b432d90e46b43bc92c6f8e5a5068d8c (127.26.52.65:34069)
I20260807 22:40:31.882753 10302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.879100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:53139 (local address 127.26.52.65:34069)
0807 22:40:31.879432 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.879438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.879455 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:40:31.879514 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.879517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.879571 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.879697 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:31.879995 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.880629 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.881728 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.882188 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.882323 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.882492 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.882541 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.882612 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":121,"threads_started":1}
I20260807 22:40:31.882750 10285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.878956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:34069 (local address 127.26.52.67:53139)
0807 22:40:31.879144 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:31.879161 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:31.879271 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:31.879710 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:31.879714 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:31.879733 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:31.879865 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.879872 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.880743 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.880748 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.881593 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.881603 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.882319 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.882323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.882435 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.882458 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:40:31.882528 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 22:40:31.882603 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260807 22:40:31.883038 10293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.879041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:60285 (local address 127.26.52.66:37629)
0807 22:40:31.879201 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.879208 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.879846 (+ 638us) server_negotiation.cc:407] Connection header received
0807 22:40:31.879999 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.880002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.880058 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.880161 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:31.880453 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.880944 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.881991 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.882413 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.882545 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.882599 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.882794 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.882900 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:40:31.883235 10303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.878965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:37629 (local address 127.26.52.67:60285)
0807 22:40:31.879753 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:31.879765 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:31.879884 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:31.880193 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:31.880195 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:31.880211 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:31.880337 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.880342 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.881064 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.881071 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.881838 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:31.881864 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.882540 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.882544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:31.882652 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.882674 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:40:31.882762 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:40:31.882999 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":314,"thread_start_us":188,"threads_started":1}
I20260807 22:40:31.883535 9935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56e8dd33cf45f0b88b348d55c0eb92" candidate_uuid: "d6f9127de2a044f9ae53c273168372ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" is_pre_election: true
I20260807 22:40:31.883869 9935 raft_consensus.cc:2454] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6f9127de2a044f9ae53c273168372ad in term 0.
I20260807 22:40:31.883899 10088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56e8dd33cf45f0b88b348d55c0eb92" candidate_uuid: "d6f9127de2a044f9ae53c273168372ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c7e381e5654c4598623bee79542171" is_pre_election: true
I20260807 22:40:31.884240 10088 raft_consensus.cc:2454] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6f9127de2a044f9ae53c273168372ad in term 0.
I20260807 22:40:31.884481 10162 leader_election.cc:302] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b432d90e46b43bc92c6f8e5a5068d8c, d6f9127de2a044f9ae53c273168372ad; no voters:
I20260807 22:40:31.884791 10300 raft_consensus.cc:2781] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:31.884883 10300 raft_consensus.cc:482] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:31.884932 10300 raft_consensus.cc:3037] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:31.886056 10300 raft_consensus.cc:504] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:31.886485 10300 leader_election.cc:288] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [CANDIDATE]: Term 1 election: Requested vote from peers 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629), 6b432d90e46b43bc92c6f8e5a5068d8c (127.26.52.65:34069)
I20260807 22:40:31.886880 10088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56e8dd33cf45f0b88b348d55c0eb92" candidate_uuid: "d6f9127de2a044f9ae53c273168372ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c7e381e5654c4598623bee79542171"
I20260807 22:40:31.886994 9935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56e8dd33cf45f0b88b348d55c0eb92" candidate_uuid: "d6f9127de2a044f9ae53c273168372ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c"
I20260807 22:40:31.887040 10088 raft_consensus.cc:3037] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:31.887178 9935 raft_consensus.cc:3037] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:31.888245 10088 raft_consensus.cc:2454] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6f9127de2a044f9ae53c273168372ad in term 1.
I20260807 22:40:31.888321 9935 raft_consensus.cc:2454] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6f9127de2a044f9ae53c273168372ad in term 1.
I20260807 22:40:31.888589 10163 leader_election.cc:302] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c7e381e5654c4598623bee79542171, d6f9127de2a044f9ae53c273168372ad; no voters:
I20260807 22:40:31.888806 10300 raft_consensus.cc:2781] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:31.889122 10300 raft_consensus.cc:686] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 1 LEADER]: Becoming Leader. State: Replica: d6f9127de2a044f9ae53c273168372ad, State: Running, Role: LEADER
I20260807 22:40:31.889503 10300 consensus_queue.cc:237] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:31.893406 9784 catalog_manager.cc:5495] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad reported cstate change: term changed from 0 to 1, leader changed from <none> to d6f9127de2a044f9ae53c273168372ad (127.26.52.67). New cstate: current_term: 1 leader_uuid: "d6f9127de2a044f9ae53c273168372ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:31.906347 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.902282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50138 (local address 127.26.52.67:39421)
0807 22:40:31.902417 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:31.902422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:31.902467 (+ 45us) server_negotiation.cc:407] Connection header received
0807 22:40:31.902791 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:31.902794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:31.902856 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:31.903006 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:31.903264 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.903777 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.904739 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:31.904965 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:31.905078 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:31.905419 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:31.905870 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:31.906024 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:31.906088 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 22:40:31.906153 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:40:31.913758 9935 raft_consensus.cc:1261] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Refusing update from remote peer d6f9127de2a044f9ae53c273168372ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:31.913827 10088 raft_consensus.cc:1261] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171 [term 1 FOLLOWER]: Refusing update from remote peer d6f9127de2a044f9ae53c273168372ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:31.914623 10300 consensus_queue.cc:1035] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:31.914870 10305 consensus_queue.cc:1035] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:31.922125 10307 mvcc.cc:205] Tried to move back new op lower bound from 7316039401108226048 to 7316039401022570496. Current Snapshot: MvccSnapshot[applied={T|T < 7316039401108226048}]
I20260807 22:40:31.925061 10310 mvcc.cc:205] Tried to move back new op lower bound from 7316039401108226048 to 7316039401022570496. Current Snapshot: MvccSnapshot[applied={T|T < 7316039401108226048}]
I20260807 22:40:31.932047 9784 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:56278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:31.932302 9784 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:56278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:31.935519 9784 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Sending DeleteTablet for 3 replicas of tablet 3b56e8dd33cf45f0b88b348d55c0eb92
I20260807 22:40:31.936658 9915 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b56e8dd33cf45f0b88b348d55c0eb92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:31 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:33602
I20260807 22:40:31.936687 10210 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b56e8dd33cf45f0b88b348d55c0eb92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:31 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:50124
I20260807 22:40:31.936753 10067 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b56e8dd33cf45f0b88b348d55c0eb92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:31 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:59456
I20260807 22:40:31.937175 10317 tablet_replica.cc:330] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: stopping tablet replica
I20260807 22:40:31.937362 10317 raft_consensus.cc:2229] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:31.937533 10317 raft_consensus.cc:2258] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:31.937669 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 9825
I20260807 22:40:31.937690 10318 tablet_replica.cc:330] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: stopping tablet replica
I20260807 22:40:31.938223 10318 raft_consensus.cc:2229] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:31.938678 10318 raft_consensus.cc:2258] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:31.942354 10318 ts_tablet_manager.cc:1905] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:31.944386 10319 tablet_replica.cc:330] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: stopping tablet replica
I20260807 22:40:31.944904 10319 raft_consensus.cc:2229] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:31.945446 10319 raft_consensus.cc:2258] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:31.946303 10318 ts_tablet_manager.cc:1918] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:31.946448 10318 log.cc:1196] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/3b56e8dd33cf45f0b88b348d55c0eb92
I20260807 22:40:31.946805 10318 ts_tablet_manager.cc:1939] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 14c7e381e5654c4598623bee79542171: Deleting consensus metadata
I20260807 22:40:31.947441 10319 ts_tablet_manager.cc:1905] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 22:40:31.948688 9770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:34069 (error 108)
W20260807 22:40:31.950050 9997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:31.949587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:34069 (local address 127.0.0.1:33618)
0807 22:40:31.949819 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:31.949904 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:34069: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":128}
I20260807 22:40:31.950084 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 9989
W20260807 22:40:31.950557 9770 catalog_manager.cc:4584] TS 6b432d90e46b43bc92c6f8e5a5068d8c (127.26.52.65:34069): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b56e8dd33cf45f0b88b348d55c0eb92: Network error: Client connection negotiation failed: client connection to 127.26.52.65:34069: connect: Connection reset by peer (error 104)
I20260807 22:40:31.956523 10319 ts_tablet_manager.cc:1918] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:31.956717 10319 log.cc:1196] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/3b56e8dd33cf45f0b88b348d55c0eb92
I20260807 22:40:31.957116 10319 ts_tablet_manager.cc:1939] T 3b56e8dd33cf45f0b88b348d55c0eb92 P d6f9127de2a044f9ae53c273168372ad: Deleting consensus metadata
I20260807 22:40:31.958611 9769 catalog_manager.cc:4841] TS d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421): tablet 3b56e8dd33cf45f0b88b348d55c0eb92 (table test-table [id=33c76d9f49624f8db43775d30f2c0d93]) successfully deleted
I20260807 22:40:31.962446 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 10144
I20260807 22:40:31.965436 9997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:31.962600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:37629 (local address 127.0.0.1:59462)
0807 22:40:31.965183 (+ 2583us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:31.965278 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.66:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2449}
I20260807 22:40:31.971273 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 9750
I20260807 22:40:31.980595 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37263
--webserver_interface=127.26.52.126
--webserver_port=34899
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:37263
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:32.104254 10321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:32.104635 10321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:32.104722 10321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:32.109027 10321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:32.109155 10321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:32.109195 10321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:32.109236 10321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:32.109272 10321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:32.115000 10321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:37263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=34899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:32.116321 10321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:32.117457 10321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:40:32.127000 10321 server_base.cc:1034] running on GCE node
W20260807 22:40:32.126925 10330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:32.126950 10327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:32.126963 10328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:32.127918 10321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:32.129225 10321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:32.130431 10321 hybrid_clock.cc:648] HybridClock initialized: now 1786142432130424 us; error 39 us; skew 500 ppm
Aug 07 22:40:32 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142432, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:32.133539 10321 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:40:32.134517 10321 webserver.cc:460] Webserver started at http://127.26.52.126:34899/ using document root <none> and password file <none>
I20260807 22:40:32.135097 10321 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:32.135159 10321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:32.139360 10321 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:32.141760 10338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:32.143196 10321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:40:32.143347 10321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "be6ca3b137bd4028898e3c85a7a2d3d1"
format_stamp: "Formatted at 2026-08-07 22:40:29 on dist-test-slave-8w9v"
server_key: "539ea1743bacc4d5728a0d87139929b7"
server_key_iv: "2b0f1baf65092098cf599decb92f5c91"
server_key_version: "encryptionkey@0"
I20260807 22:40:32.143962 10321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:32.157899 10321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:32.161674 10321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:32.161934 10321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:32.170166 10321 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:37263
I20260807 22:40:32.170511 10395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:37263 every 8 connection(s)
I20260807 22:40:32.171566 10321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:32.176364 10396 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:40:32.178804 10396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Bootstrap starting.
I20260807 22:40:32.178983 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 10321
I20260807 22:40:32.179466 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:34069
--local_ip_for_outbound_sockets=127.26.52.65
--tserver_master_addrs=127.26.52.126:37263
--webserver_port=44667
--webserver_interface=127.26.52.65
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:40:32.197693 10396 log.cc:824] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:32.209867 10396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:40:32.210333 10396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1: Bootstrap complete.
I20260807 22:40:32.214640 10396 raft_consensus.cc:348] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:32.215108 10396 raft_consensus.cc:729] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: be6ca3b137bd4028898e3c85a7a2d3d1, State: Initialized, Role: FOLLOWER
I20260807 22:40:32.215677 10396 consensus_queue.cc:260] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:32.215845 10396 raft_consensus.cc:388] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:32.215931 10396 raft_consensus.cc:482] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:32.216084 10396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:40:32.218214 10396 raft_consensus.cc:504] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:32.218606 10396 leader_election.cc:302] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be6ca3b137bd4028898e3c85a7a2d3d1; no voters:
I20260807 22:40:32.218979 10396 leader_election.cc:288] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 22:40:32.219141 10401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 22:40:32.219429 10401 raft_consensus.cc:686] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [term 3 LEADER]: Becoming Leader. State: Replica: be6ca3b137bd4028898e3c85a7a2d3d1, State: Running, Role: LEADER
I20260807 22:40:32.219767 10401 consensus_queue.cc:237] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } }
I20260807 22:40:32.220441 10396 sys_catalog.cc:564] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:32.221352 10402 sys_catalog.cc:455] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } } }
I20260807 22:40:32.221491 10402 sys_catalog.cc:458] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:32.222187 10403 sys_catalog.cc:455] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be6ca3b137bd4028898e3c85a7a2d3d1. Latest consensus state: current_term: 3 leader_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6ca3b137bd4028898e3c85a7a2d3d1" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37263 } } }
I20260807 22:40:32.222297 10403 sys_catalog.cc:458] T 00000000000000000000000000000000 P be6ca3b137bd4028898e3c85a7a2d3d1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:32.222599 10411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:32.228787 10411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:32.229499 10411 catalog_manager.cc:1259] Loaded cluster ID: f32d6af287d244f19bcbb9a59fd7add6
I20260807 22:40:32.229563 10411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 22:40:32.230847 10411 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8e6ff759ad google::LogMessage::Fail() at ??:0
@ 0x7f8e6ff7888a google::LogMessage::SendToLog() at ??:0
@ 0x7f8e6ff754de google::LogMessage::Flush() at ??:0
@ 0x7f8e6ff76a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8e7a8b4fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f8e7a8b5d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8e7a8b2579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f8e7a8f6640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f8e721c73d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8e721c7c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f8e721c93f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f8e721b8512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8e737fc6db start_thread at ??:0
@ 0x7f8e6ea7361f clone at ??:0
W20260807 22:40:32.324440 10398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:32.324797 10398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:32.324875 10398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:32.329380 10398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:32.329480 10398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:32.329573 10398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:40:32.335433 10398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:34069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=44667
--tserver_master_addrs=127.26.52.126:37263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:32.336802 10398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:32.337973 10398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:32.349150 10445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:32.349150 10443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:32.349150 10442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:32.350389 10398 server_base.cc:1034] running on GCE node
I20260807 22:40:32.350875 10398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:32.351727 10398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:32.352917 10398 hybrid_clock.cc:648] HybridClock initialized: now 1786142432352881 us; error 53 us; skew 500 ppm
Aug 07 22:40:32 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142432, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:32.355983 10398 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:40:32.357177 10398 webserver.cc:460] Webserver started at http://127.26.52.65:44667/ using document root <none> and password file <none>
I20260807 22:40:32.357843 10398 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:32.357913 10398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:32.362576 10398 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:40:32.365113 10452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:32.366711 10398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:32.366861 10398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "6b432d90e46b43bc92c6f8e5a5068d8c"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "96cd7c85ae8332220c4946795302cdc0"
server_key_iv: "efde409a55c69de652e12a0a55af302c"
server_key_version: "encryptionkey@0"
I20260807 22:40:32.367517 10398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:32.383901 10398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:32.387836 10398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:32.388108 10398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:32.388927 10398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:32.390229 10459 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:40:32.395750 10398 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:40:32.395861 10398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.001s
I20260807 22:40:32.395933 10398 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:40:32.398094 10398 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:40:32.398198 10398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 22:40:32.398600 10459 tablet_bootstrap.cc:492] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: Bootstrap starting.
I20260807 22:40:32.409796 10398 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:34069
I20260807 22:40:32.409891 10578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:34069 every 8 connection(s)
I20260807 22:40:32.410912 10398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:32.418649 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 10398
I20260807 22:40:32.419169 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:37629
--local_ip_for_outbound_sockets=127.26.52.66
--tserver_master_addrs=127.26.52.126:37263
--webserver_port=35375
--webserver_interface=127.26.52.66
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:40:32.422873 10459 log.cc:824] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:32.433444 10459 tablet_bootstrap.cc:492] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:40:32.433966 10459 tablet_bootstrap.cc:492] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: Bootstrap complete.
I20260807 22:40:32.435580 10459 ts_tablet_manager.cc:1397] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: Time spent bootstrapping tablet: real 0.037s user 0.029s sys 0.004s
I20260807 22:40:32.439357 10459 raft_consensus.cc:348] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:32.439968 10459 raft_consensus.cc:729] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b432d90e46b43bc92c6f8e5a5068d8c, State: Initialized, Role: FOLLOWER
I20260807 22:40:32.440608 10459 consensus_queue.cc:260] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:32.441860 10459 ts_tablet_manager.cc:1428] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c: Time spent starting tablet: real 0.006s user 0.009s sys 0.000s
W20260807 22:40:32.473362 10581 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:32.413118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:44469)
0807 22:40:32.413683 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:32.413741 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:32.414609 (+ 868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:32.472455 (+ 57846us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":180,"threads_started":1}
W20260807 22:40:32.473868 10579 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:37263 (0 consecutive failures): Network error: Failed to ping master at 127.26.52.126:37263: Client connection negotiation failed: client connection to 127.26.52.126:37263: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 22:40:32.474709 10581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:32.474427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:34075)
0807 22:40:32.474575 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:32.474645 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 22:40:32.475457 10581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:32.475229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:41431)
0807 22:40:32.475339 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:32.475402 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 22:40:32.475641 10579 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:40:32.546926 10582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:32.547255 10582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:32.547343 10582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:32.551826 10582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:32.551928 10582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:32.552032 10582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:40:32.557983 10582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:37629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=35375
--tserver_master_addrs=127.26.52.126:37263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:32.559212 10582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:32.560365 10582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:32.570943 10593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:32.570987 10590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:32.570966 10591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:32.571398 10582 server_base.cc:1034] running on GCE node
I20260807 22:40:32.571882 10582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:32.572698 10582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:32.573920 10582 hybrid_clock.cc:648] HybridClock initialized: now 1786142432573892 us; error 40 us; skew 500 ppm
Aug 07 22:40:32 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142432, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:32.581718 10582 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:40:32.582819 10582 webserver.cc:460] Webserver started at http://127.26.52.66:35375/ using document root <none> and password file <none>
I20260807 22:40:32.583470 10582 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:32.583570 10582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:32.587875 10582 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:32.590240 10601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:32.591583 10582 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:32.591734 10582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "14c7e381e5654c4598623bee79542171"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "8f5da6782ac2e0dbf877a42e9ffd71c9"
server_key_iv: "fdcf7582d38e2f28ab98373bd4a066e6"
server_key_version: "encryptionkey@0"
I20260807 22:40:32.592411 10582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:32.618254 10582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:32.621546 10582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:32.621784 10582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:32.622473 10582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:32.623420 10582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:32.623497 10582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:32.623576 10582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:32.623620 10582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:32.633484 10582 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:37629
I20260807 22:40:32.633529 10723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:37629 every 8 connection(s)
I20260807 22:40:32.634605 10582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:32.638880 10726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:32.636971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:59735)
0807 22:40:32.637478 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:32.637605 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":127,"threads_started":1}
I20260807 22:40:32.639377 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 10582
W20260807 22:40:32.639505 10724 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:37263 (0 consecutive failures): Network error: Failed to ping master at 127.26.52.126:37263: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
I20260807 22:40:32.639895 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:39421
--local_ip_for_outbound_sockets=127.26.52.67
--tserver_master_addrs=127.26.52.126:37263
--webserver_port=37003
--webserver_interface=127.26.52.67
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:40:32.640334 10726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:32.639982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:38403)
0807 22:40:32.640207 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:32.640267 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260807 22:40:32.640985 10726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:32.640763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:55159)
0807 22:40:32.640876 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:32.640923 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 22:40:32.641191 10724 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:40:32.760179 10727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:32.760526 10727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:32.760608 10727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:32.764801 10727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:32.764918 10727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:32.765020 10727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:40:32.770790 10727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:39421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=37003
--tserver_master_addrs=127.26.52.126:37263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:32.772150 10727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:32.773294 10727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:32.784103 10732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:32.784199 10727 server_base.cc:1034] running on GCE node
W20260807 22:40:32.784227 10735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:32.784169 10733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:32.784929 10727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:32.785709 10727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:32.786916 10727 hybrid_clock.cc:648] HybridClock initialized: now 1786142432786876 us; error 58 us; skew 500 ppm
Aug 07 22:40:32 dist-test-slave-8w9v krb5kdc[9158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142432, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:32.789979 10727 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:40:32.791477 10727 webserver.cc:460] Webserver started at http://127.26.52.67:37003/ using document root <none> and password file <none>
I20260807 22:40:32.792083 10727 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:32.792215 10727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:32.796976 10727 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260807 22:40:32.799316 10742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:32.800802 10727 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:40:32.800990 10727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "d6f9127de2a044f9ae53c273168372ad"
format_stamp: "Formatted at 2026-08-07 22:40:30 on dist-test-slave-8w9v"
server_key: "80d2abd560d53b4078257cb53b854d2e"
server_key_iv: "3b48f1fa0044a4a34a31499019f67033"
server_key_version: "encryptionkey@0"
I20260807 22:40:32.801582 10727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:32.814720 10727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:32.818711 10727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:32.818969 10727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:32.819660 10727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:32.820631 10727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:32.820681 10727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:32.820755 10727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:32.820799 10727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:32.830307 10727 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:39421
I20260807 22:40:32.830363 10863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:39421 every 8 connection(s)
I20260807 22:40:32.831408 10727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:32.835518 10867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:32.833692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:42673)
0807 22:40:32.834195 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:32.834322 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":142,"threads_started":1}
W20260807 22:40:32.836031 10864 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:37263 (0 consecutive failures): Network error: Failed to ping master at 127.26.52.126:37263: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
I20260807 22:40:32.836710 10867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:32.836491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:51911)
0807 22:40:32.836605 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:32.836655 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 22:40:32.837378 10867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:32.837195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:37365)
0807 22:40:32.837287 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:32.837328 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 22:40:32.837607 10864 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 22:40:32.838666 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 10727
I20260807 22:40:33.476902 10870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:33.476411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:51995)
0807 22:40:33.476715 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:33.476787 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":108,"threads_started":1}
I20260807 22:40:33.642354 10871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:33.641862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:38207)
0807 22:40:33.642156 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:33.642224 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":79,"threads_started":1}
I20260807 22:40:33.838717 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:33.838247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:48875)
0807 22:40:33.838550 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:33.838611 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":80,"threads_started":1}
I20260807 22:40:33.876847 10874 raft_consensus.cc:482] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:33.877060 10874 raft_consensus.cc:504] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:33.878113 10874 leader_election.cc:288] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421), 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629)
Aug 07 22:40:33 dist-test-slave-8w9v krb5kdc[9158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142432, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.67@KRBTEST.COM
Aug 07 22:40:33 dist-test-slave-8w9v krb5kdc[9158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142432, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.66@KRBTEST.COM
I20260807 22:40:33.895404 10876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:33.878570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:34415 (local address 127.26.52.66:37629)
0807 22:40:33.878991 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:33.879019 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:33.879066 (+ 47us) server_negotiation.cc:407] Connection header received
0807 22:40:33.880002 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:33.880011 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:33.880528 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:33.880884 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:33.882866 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:33.884497 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:33.886575 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:33.887307 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:33.887474 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:33.890741 (+ 3267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:33.890745 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:33.890755 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:33.890787 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:33.892660 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:33.893278 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:33.893286 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:33.893292 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:33.893423 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:33.893822 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:33.893824 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:33.893825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:33.894229 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:33.894362 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:33.894937 (+ 575us) server_negotiation.cc:299] Negotiation successful
0807 22:40:33.895200 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":72,"threads_started":1}
I20260807 22:40:33.895387 10870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:33.878382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:39421 (local address 127.26.52.65:35521)
0807 22:40:33.878663 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:33.878680 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:33.878801 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:33.881022 (+ 2221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:33.881030 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:33.881717 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:33.882573 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:33.882597 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:33.884680 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:33.884684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:33.886409 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:33.886432 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:33.887303 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:33.887307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:33.887511 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:33.888375 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:33.888394 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:33.890139 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:33.892744 (+ 2605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:33.892755 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:33.892772 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:33.893168 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:33.893563 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:33.893565 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:33.893566 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:33.893688 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:33.894386 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:33.894389 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:33.894602 (+ 213us) client_negotiation.cc:769] Sending connection context
0807 22:40:33.894802 (+ 200us) client_negotiation.cc:240] Negotiation successful
0807 22:40:33.895194 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":270,"spinlock_wait_cycles":72192}
I20260807 22:40:33.895429 10877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:33.878566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:35521 (local address 127.26.52.67:39421)
0807 22:40:33.878991 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:33.879019 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:33.879066 (+ 47us) server_negotiation.cc:407] Connection header received
0807 22:40:33.880002 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:33.880011 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:33.880528 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:33.880884 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:33.882866 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:33.884497 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:33.886558 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:33.887162 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:33.887338 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:33.890448 (+ 3110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:33.890456 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:33.890477 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:33.890517 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:33.892611 (+ 2094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:33.893311 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:33.893316 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:33.893320 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:33.893434 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:33.893789 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:33.893792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:33.893794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:33.894231 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:33.894377 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:33.894918 (+ 541us) server_negotiation.cc:299] Negotiation successful
0807 22:40:33.895223 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":125,"threads_started":1}
I20260807 22:40:33.895448 10875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:33.878382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:37629 (local address 127.26.52.65:34415)
0807 22:40:33.878663 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:33.878680 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:33.878801 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:33.881022 (+ 2221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:33.881030 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:33.881717 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:33.882573 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:33.882597 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:33.884680 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:33.884684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:33.886432 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:33.886439 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:33.887559 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:33.887562 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:33.887638 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:33.888320 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:33.888338 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:33.890533 (+ 2195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:33.892813 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:33.892816 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:33.892817 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:33.893152 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:33.893538 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:33.893541 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:33.893543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:33.893696 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:33.894360 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:33.894367 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:33.894603 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 22:40:33.894801 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 22:40:33.895284 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":609,"spinlock_wait_cycles":16896,"thread_start_us":62,"threads_started":1}
W20260807 22:40:33.898123 10456 leader_election.cc:341] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629): Not found: Tablet not found: 3b56e8dd33cf45f0b88b348d55c0eb92
W20260807 22:40:33.898386 10454 leader_election.cc:341] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421): Not found: Tablet not found: 3b56e8dd33cf45f0b88b348d55c0eb92
I20260807 22:40:33.898475 10454 leader_election.cc:302] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b432d90e46b43bc92c6f8e5a5068d8c; no voters: 14c7e381e5654c4598623bee79542171, d6f9127de2a044f9ae53c273168372ad
I20260807 22:40:33.898774 10874 raft_consensus.cc:2726] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:40:34.478181 10878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:34.477751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:39827)
0807 22:40:34.478027 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:34.478082 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":95,"threads_started":1}
I20260807 22:40:34.643934 10879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:34.643408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:60933)
0807 22:40:34.643746 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:34.643821 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":81,"threads_started":1}
I20260807 22:40:34.840111 10880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:34.839560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:36909)
0807 22:40:34.839941 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:34.840011 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":82,"threads_started":1}
I20260807 22:40:35.479737 10881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:35.479099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:45471)
0807 22:40:35.479508 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:35.479593 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":92,"threads_started":1}
I20260807 22:40:35.645330 10882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:35.644826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:35111)
0807 22:40:35.645137 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:35.645200 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":97,"threads_started":1}
I20260807 22:40:35.841589 10883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:35.841036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:51609)
0807 22:40:35.841386 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:35.841468 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":107,"threads_started":1}
I20260807 22:40:36.105827 10884 raft_consensus.cc:482] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:36.106020 10884 raft_consensus.cc:504] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:36.106582 10884 leader_election.cc:288] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421), 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629)
W20260807 22:40:36.107476 10454 leader_election.cc:341] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421): Not found: Tablet not found: 3b56e8dd33cf45f0b88b348d55c0eb92
W20260807 22:40:36.107630 10456 leader_election.cc:341] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629): Not found: Tablet not found: 3b56e8dd33cf45f0b88b348d55c0eb92
I20260807 22:40:36.107724 10456 leader_election.cc:302] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b432d90e46b43bc92c6f8e5a5068d8c; no voters: 14c7e381e5654c4598623bee79542171, d6f9127de2a044f9ae53c273168372ad
I20260807 22:40:36.107926 10884 raft_consensus.cc:2726] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:40:36.481160 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:36.480699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:49377)
0807 22:40:36.480991 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:36.481055 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":83,"threads_started":1}
I20260807 22:40:36.646862 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:36.646359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:32839)
0807 22:40:36.646685 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:36.646754 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":102,"threads_started":1}
I20260807 22:40:36.842981 10887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:36.842498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:49795)
0807 22:40:36.842801 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:36.842866 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":84,"threads_started":1}
I20260807 22:40:37.482712 10888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:37.482199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:59755)
0807 22:40:37.482542 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:37.482609 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":112,"threads_started":1}
I20260807 22:40:37.648567 10889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:37.648037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:57827)
0807 22:40:37.648398 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:37.648466 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":147,"threads_started":1}
I20260807 22:40:37.844388 10890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:37.843855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:36999)
0807 22:40:37.844220 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:37.844287 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":92,"threads_started":1}
I20260807 22:40:38.484050 10891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:38.483582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:59839)
0807 22:40:38.483867 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:38.483941 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":83,"threads_started":1}
I20260807 22:40:38.650146 10892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:38.649624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:45349)
0807 22:40:38.649969 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:38.650038 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":115,"threads_started":1}
I20260807 22:40:38.809129 10894 raft_consensus.cc:482] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:38.809396 10894 raft_consensus.cc:504] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:38.809966 10894 leader_election.cc:288] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421), 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629)
W20260807 22:40:38.810778 10454 leader_election.cc:341] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421): Not found: Tablet not found: 3b56e8dd33cf45f0b88b348d55c0eb92
W20260807 22:40:38.810907 10456 leader_election.cc:341] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629): Not found: Tablet not found: 3b56e8dd33cf45f0b88b348d55c0eb92
I20260807 22:40:38.811007 10456 leader_election.cc:302] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b432d90e46b43bc92c6f8e5a5068d8c; no voters: 14c7e381e5654c4598623bee79542171, d6f9127de2a044f9ae53c273168372ad
I20260807 22:40:38.811199 10894 raft_consensus.cc:2726] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:40:38.845743 10895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:38.845216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:39461)
0807 22:40:38.845546 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:38.845633 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":92,"threads_started":1}
I20260807 22:40:39.485605 10896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:39.485087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:55513)
0807 22:40:39.485401 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:39.485485 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":95,"threads_started":1}
I20260807 22:40:39.651670 10897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:39.651116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:57703)
0807 22:40:39.651488 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:39.651567 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":81,"threads_started":1}
I20260807 22:40:39.847129 10898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:39.846634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:48243)
0807 22:40:39.846974 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:39.847029 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":98,"threads_started":1}
I20260807 22:40:40.487072 10899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.486584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:42913)
0807 22:40:40.486889 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:40.486961 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":84,"threads_started":1}
I20260807 22:40:40.653208 10900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.652696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:42213)
0807 22:40:40.653033 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:40.653102 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":87,"threads_started":1}
I20260807 22:40:40.848481 10901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.847972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:34701)
0807 22:40:40.848316 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:40.848376 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":99,"threads_started":1}
I20260807 22:40:41.488622 10902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:41.488058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:34091)
0807 22:40:41.488444 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:41.488514 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":140,"threads_started":1}
I20260807 22:40:41.654599 10904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:41.654141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:51447)
0807 22:40:41.654430 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:41.654498 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":85,"threads_started":1}
I20260807 22:40:41.849790 10905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:41.849271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:47215)
0807 22:40:41.849609 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:41.849677 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":106,"threads_started":1}
I20260807 22:40:42.490091 10906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.489667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:36473)
0807 22:40:42.489926 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.489985 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":76,"threads_started":1}
I20260807 22:40:42.655936 10907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.655478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:48891)
0807 22:40:42.655773 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.655826 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":112,"threads_started":1}
I20260807 22:40:42.851222 10908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.850699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:48605)
0807 22:40:42.851029 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.851116 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":87,"threads_started":1}
I20260807 22:40:43.446377 10910 raft_consensus.cc:482] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:43.446568 10910 raft_consensus.cc:504] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f9127de2a044f9ae53c273168372ad" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 39421 } } peers { permanent_uuid: "14c7e381e5654c4598623bee79542171" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 37629 } } peers { permanent_uuid: "6b432d90e46b43bc92c6f8e5a5068d8c" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34069 } }
I20260807 22:40:43.447048 10910 leader_election.cc:288] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421), 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629)
W20260807 22:40:43.447893 10454 leader_election.cc:341] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d6f9127de2a044f9ae53c273168372ad (127.26.52.67:39421): Not found: Tablet not found: 3b56e8dd33cf45f0b88b348d55c0eb92
W20260807 22:40:43.447989 10456 leader_election.cc:341] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14c7e381e5654c4598623bee79542171 (127.26.52.66:37629): Not found: Tablet not found: 3b56e8dd33cf45f0b88b348d55c0eb92
I20260807 22:40:43.448035 10454 leader_election.cc:302] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b432d90e46b43bc92c6f8e5a5068d8c; no voters: 14c7e381e5654c4598623bee79542171, d6f9127de2a044f9ae53c273168372ad
I20260807 22:40:43.448221 10910 raft_consensus.cc:2726] T 3b56e8dd33cf45f0b88b348d55c0eb92 P 6b432d90e46b43bc92c6f8e5a5068d8c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:40:43.491349 10911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.490899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:51517)
0807 22:40:43.491179 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.491242 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":77,"threads_started":1}
I20260807 22:40:43.657349 10912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.656854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:36573)
0807 22:40:43.657182 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.657246 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":117,"threads_started":1}
I20260807 22:40:43.852815 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.852330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:55011)
0807 22:40:43.852631 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.852702 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":94,"threads_started":1}
I20260807 22:40:44.492872 10914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:44.492411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:42385)
0807 22:40:44.492694 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:44.492763 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":84,"threads_started":1}
I20260807 22:40:44.658867 10915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:44.658324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:49465)
0807 22:40:44.658677 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:44.658758 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":107,"threads_started":1}
I20260807 22:40:44.854365 10916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:44.853875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:59831)
0807 22:40:44.854187 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:44.854258 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":97,"threads_started":1}
I20260807 22:40:45.494199 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:45.493713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:38569)
0807 22:40:45.494025 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:45.494093 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":98,"threads_started":1}
I20260807 22:40:45.660293 10918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:45.659709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:58645)
0807 22:40:45.660047 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:45.660113 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":104,"threads_started":1}
I20260807 22:40:45.855844 10919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:45.855356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:54297)
0807 22:40:45.855674 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:45.855740 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":108,"threads_started":1}
I20260807 22:40:46.495486 10920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.495048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:58337)
0807 22:40:46.495320 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:46.495379 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":95,"threads_started":1}
I20260807 22:40:46.661554 10922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.661070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:43267)
0807 22:40:46.661372 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:46.661450 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":100,"threads_started":1}
I20260807 22:40:46.857260 10923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.856757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:34361)
0807 22:40:46.857081 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:46.857154 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":89,"threads_started":1}
I20260807 22:40:47.497216 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:47.496726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.65:57569)
0807 22:40:47.497058 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:47.497115 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":84,"threads_started":1}
I20260807 22:40:47.663148 10925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:47.662666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.66:55397)
0807 22:40:47.662976 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:47.663043 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":83,"threads_started":1}
I20260807 22:40:47.841639 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 10398
I20260807 22:40:47.852332 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 10582
I20260807 22:40:47.858878 10926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:47.858423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37263 (local address 127.26.52.67:47039)
0807 22:40:47.858716 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:47.858779 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":100,"threads_started":1}
I20260807 22:40:47.860988 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 10727
2026-08-07T22:40:47Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19484 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:47 dist-test-slave-8w9v krb5kdc[10929](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:47 dist-test-slave-8w9v krb5kdc[10929](info): set up 2 sockets
Aug 07 22:40:47 dist-test-slave-8w9v krb5kdc[10929](info): commencing operation
krb5kdc: starting...
W20260807 22:40:48.944778 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:40:49 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:40:49.084111 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37831
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:37831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:49.203181 10944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:49.203548 10944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:49.203593 10944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:49.207906 10944 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 22:40:49.208001 10944 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 22:40:49.208017 10944 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 22:40:49.208031 10944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:49.208051 10944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:49.208071 10944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:49.208087 10944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:49.208173 10944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:49.214205 10944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:37831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:49.215489 10944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:49.216723 10944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:40:49.226763 10944 server_base.cc:1034] running on GCE node
W20260807 22:40:49.226900 10950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.226900 10951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.227092 10953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.227741 10944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:49.229086 10944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:49.230269 10944 hybrid_clock.cc:648] HybridClock initialized: now 1786142449230254 us; error 30 us; skew 500 ppm
Aug 07 22:40:49 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:49.236629 10944 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:40:49.237720 10944 webserver.cc:460] Webserver started at http://127.26.52.126:36741/ using document root <none> and password file <none>
I20260807 22:40:49.238301 10944 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.238365 10944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.238554 10944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:49.240770 10944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "83b6c12821374e1a9cdb40836091d100"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "6262b0a8b0c470a23713f91c66c327e1"
server_key_iv: "e53db029c1587d2ace67fd7efbde937e"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.241374 10944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "83b6c12821374e1a9cdb40836091d100"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "6262b0a8b0c470a23713f91c66c327e1"
server_key_iv: "e53db029c1587d2ace67fd7efbde937e"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.245428 10944 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:40:49.248066 10960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.249476 10944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:40:49.249631 10944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "83b6c12821374e1a9cdb40836091d100"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "6262b0a8b0c470a23713f91c66c327e1"
server_key_iv: "e53db029c1587d2ace67fd7efbde937e"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.249756 10944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.289541 10944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:49.292798 10944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:49.293025 10944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:49.300547 10944 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:37831
I20260807 22:40:49.300925 11013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:37831 every 8 connection(s)
I20260807 22:40:49.301549 10944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:49.302798 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 10944
I20260807 22:40:49.302948 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:40:49.303257 26833 external_mini_cluster.cc:1428] Setting key 48489a829aee5a881d39d3364ce90dcb
I20260807 22:40:49.304806 11014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:49.311896 11014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Bootstrap starting.
Aug 07 22:40:49 dist-test-slave-8w9v krb5kdc[10929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:49.314445 11014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:49.315434 11014 log.cc:824] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:49.318010 11014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: No bootstrap required, opened a new log
I20260807 22:40:49.318918 11017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.304783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60094 (local address 127.26.52.126:37831)
0807 22:40:49.305239 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.305263 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.305298 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:40:49.305961 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.305977 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.306290 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.306565 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.307574 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.308657 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.309858 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.310335 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.310453 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.313518 (+ 3065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.313524 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.313537 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.313566 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.315627 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.316202 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.316207 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.316212 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.316338 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.316655 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.316658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.316660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.317179 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.317382 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.317627 (+ 245us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.317948 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":158,"threads_started":1}
I20260807 22:40:49.322252 11014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:40:49.322512 11014 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:49.322595 11014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83b6c12821374e1a9cdb40836091d100, State: Initialized, Role: FOLLOWER
I20260807 22:40:49.323091 11014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:40:49.323285 11014 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:49.323355 11014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:49.323465 11014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:49.324510 11014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:40:49.324859 11014 leader_election.cc:302] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83b6c12821374e1a9cdb40836091d100; no voters:
I20260807 22:40:49.325194 11014 leader_election.cc:288] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:49.325342 11021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:49.325887 11021 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 1 LEADER]: Becoming Leader. State: Replica: 83b6c12821374e1a9cdb40836091d100, State: Running, Role: LEADER
I20260807 22:40:49.326288 11021 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:40:49.326630 11014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:49.327936 11023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83b6c12821374e1a9cdb40836091d100. Latest consensus state: current_term: 1 leader_uuid: "83b6c12821374e1a9cdb40836091d100" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } } }
I20260807 22:40:49.328279 11022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83b6c12821374e1a9cdb40836091d100" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } } }
I20260807 22:40:49.328380 11022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:49.328095 11023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: This master's current role is: LEADER
W20260807 22:40:49.331485 11037 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:40:49.331557 11037 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:40:49.331643 11035 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:49.332489 11035 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:49.337715 11035 catalog_manager.cc:1347] Generated new cluster ID: 2abbd27b4e9f4ab39240af6054a8d16a
I20260807 22:40:49.337797 11035 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:49.350190 11035 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:49.351135 11035 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:49.362092 11035 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Generated new TSK 0
I20260807 22:40:49.362886 11035 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:40:49.396389 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37831
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:49.517797 11044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:49.518106 11044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:49.518151 11044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:49.522361 11044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:49.522442 11044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:49.522504 11044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:40:49.528571 11044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:49.529809 11044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:49.530856 11044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:49.541560 11049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.541550 11044 server_base.cc:1034] running on GCE node
W20260807 22:40:49.541786 11052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.541520 11050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.542336 11044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:49.543045 11044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:49.544210 11044 hybrid_clock.cc:648] HybridClock initialized: now 1786142449544191 us; error 31 us; skew 500 ppm
Aug 07 22:40:49 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:49.547333 11044 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:40:49.548409 11044 webserver.cc:460] Webserver started at http://127.26.52.65:45737/ using document root <none> and password file <none>
I20260807 22:40:49.549017 11044 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.549080 11044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.549319 11044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:49.551502 11044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "61e0a4f0e52f4cfb849e20e48cd00682"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "e53de9427f5f65ef0dddca154592d4b9"
server_key_iv: "20b0a2ed459615132efac2a3fb1d4fe7"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.552086 11044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "61e0a4f0e52f4cfb849e20e48cd00682"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "e53de9427f5f65ef0dddca154592d4b9"
server_key_iv: "20b0a2ed459615132efac2a3fb1d4fe7"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.556502 11044 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:40:49.559089 11060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.560472 11044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:49.560616 11044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "61e0a4f0e52f4cfb849e20e48cd00682"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "e53de9427f5f65ef0dddca154592d4b9"
server_key_iv: "20b0a2ed459615132efac2a3fb1d4fe7"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.560745 11044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.581496 11044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:49.584949 11044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:49.585179 11044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:49.585852 11044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:49.586771 11044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:49.586843 11044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.586927 11044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:49.586977 11044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.596769 11044 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:38627
I20260807 22:40:49.596792 11186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:38627 every 8 connection(s)
I20260807 22:40:49.597757 11044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:49.604480 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 11044
I20260807 22:40:49.604653 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:49.604970 26833 external_mini_cluster.cc:1428] Setting key cf17c36855754fc527f7e03f6fb8fe93
Aug 07 22:40:49 dist-test-slave-8w9v krb5kdc[10929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:49.613299 11017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.599750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:47629 (local address 127.26.52.126:37831)
0807 22:40:49.599903 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.599914 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.600849 (+ 935us) server_negotiation.cc:407] Connection header received
0807 22:40:49.602135 (+ 1286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.602138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.602186 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.602267 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.603496 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.604081 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.605557 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.605879 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.605990 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.608689 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.608696 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.608701 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.608739 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.610584 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.611210 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.611217 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.611223 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.611334 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.611817 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.611822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.611825 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.612156 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.612283 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.612843 (+ 560us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.613027 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:40:49.614051 11189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.600167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:47629)
0807 22:40:49.600667 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.600711 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.601928 (+ 1217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.602441 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.602447 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.602823 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.603328 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.603342 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.604326 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.604330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.605416 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.605427 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.606042 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.606045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.606206 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.606953 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.606971 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.608506 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.610740 (+ 2234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.610746 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.610762 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.611091 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.611486 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.611491 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.611496 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.611692 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.612276 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.612283 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.612560 (+ 277us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.612739 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.613043 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":149,"threads_started":1}
I20260807 22:40:49.615510 11187 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37831
I20260807 22:40:49.615792 11187 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:40:49.616447 11187 heartbeater.cc:511] Master 127.26.52.126:37831 requested a full tablet report, sending...
I20260807 22:40:49.618112 10977 ts_manager.cc:194] Registered new tserver with Master: 61e0a4f0e52f4cfb849e20e48cd00682 (127.26.52.65:38627)
I20260807 22:40:49.619251 10977 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:47629
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:40:49.640600 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37831
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:49.766242 11192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:49.766556 11192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:49.766602 11192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:49.770825 11192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:49.770913 11192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:49.770978 11192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:40:49.776729 11192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:49.777894 11192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:49.778975 11192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:49.789563 11200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.789563 11198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.789563 11197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.789981 11192 server_base.cc:1034] running on GCE node
I20260807 22:40:49.790443 11192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:49.791286 11192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:49.792496 11192 hybrid_clock.cc:648] HybridClock initialized: now 1786142449792471 us; error 40 us; skew 500 ppm
Aug 07 22:40:49 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:49.795536 11192 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:40:49.796634 11192 webserver.cc:460] Webserver started at http://127.26.52.66:36559/ using document root <none> and password file <none>
I20260807 22:40:49.797279 11192 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.797349 11192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.797587 11192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:49.799906 11192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "028e8b3cd1b449dd83575f6e38859fef"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "b70ec01fdb4d4279c30377cc5fee0c9f"
server_key_iv: "698eb63694276808b6ee410d5fd5c658"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.800601 11192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "028e8b3cd1b449dd83575f6e38859fef"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "b70ec01fdb4d4279c30377cc5fee0c9f"
server_key_iv: "698eb63694276808b6ee410d5fd5c658"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.804804 11192 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:40:49.807597 11207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.809168 11192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 22:40:49.809372 11192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "028e8b3cd1b449dd83575f6e38859fef"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "b70ec01fdb4d4279c30377cc5fee0c9f"
server_key_iv: "698eb63694276808b6ee410d5fd5c658"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.809515 11192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.829075 11192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:49.832726 11192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:49.832962 11192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:49.833619 11192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:49.834501 11192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:49.834573 11192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.834647 11192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:49.834699 11192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.844050 11192 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:40697
I20260807 22:40:49.844071 11325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:40697 every 8 connection(s)
I20260807 22:40:49.845082 11192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:49.849016 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 11192
I20260807 22:40:49.849161 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:49.849488 26833 external_mini_cluster.cc:1428] Setting key 9d24ea35f1676853e9295de675c426b5
Aug 07 22:40:49 dist-test-slave-8w9v krb5kdc[10929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:40:49.861280 11017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.847156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:55135 (local address 127.26.52.126:37831)
0807 22:40:49.847306 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.847310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.848360 (+ 1050us) server_negotiation.cc:407] Connection header received
0807 22:40:49.849954 (+ 1594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.849958 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.850025 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.850138 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.851382 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.851930 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.853512 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.853739 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.853839 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.856995 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.857002 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.857009 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.857035 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.858729 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.859369 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.859374 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.859378 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.859476 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.859898 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.859902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.859904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.860178 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.860326 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.861021 (+ 695us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.861146 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:40:49.862298 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.847569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:55135)
0807 22:40:49.848096 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.848221 (+ 125us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.849716 (+ 1495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.850328 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.850336 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.850719 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.851222 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.851236 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.852070 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.852078 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.853363 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.853379 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.853925 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.853932 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.854177 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.854858 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.854884 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.856784 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.858894 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.858901 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.858920 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.859237 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.859591 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.859594 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.859597 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.859776 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.860348 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.860356 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.860712 (+ 356us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.860891 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.861177 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":141,"threads_started":1}
I20260807 22:40:49.863840 11326 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37831
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
I20260807 22:40:49.864177 11326 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:49.864777 11326 heartbeater.cc:511] Master 127.26.52.126:37831 requested a full tablet report, sending...
I20260807 22:40:49.866019 10977 ts_manager.cc:194] Registered new tserver with Master: 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697)
I20260807 22:40:49.866671 10977 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:55135
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:40:49.883831 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37831
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:50.003927 11331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:50.004267 11331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:50.004372 11331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:50.008597 11331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:50.008685 11331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:50.008787 11331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:40:50.014840 11331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:40:50.016142 11331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:50.017297 11331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:50.029127 11336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:50.029127 11339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:50.029163 11337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:50.029584 11331 server_base.cc:1034] running on GCE node
I20260807 22:40:50.030151 11331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:50.030882 11331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:50.032074 11331 hybrid_clock.cc:648] HybridClock initialized: now 1786142450032048 us; error 39 us; skew 500 ppm
Aug 07 22:40:50 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142450, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:50.035063 11331 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:40:50.036164 11331 webserver.cc:460] Webserver started at http://127.26.52.67:46817/ using document root <none> and password file <none>
I20260807 22:40:50.036800 11331 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:50.036896 11331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:50.037225 11331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:50.039474 11331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "e12c363ffb734666a927a6e547561c64"
format_stamp: "Formatted at 2026-08-07 22:40:50 on dist-test-slave-8w9v"
server_key: "1f3ed498d8585fd4b145a4706703a2dc"
server_key_iv: "65b0dc0ac252cbe98e2700cbae797d5d"
server_key_version: "encryptionkey@0"
I20260807 22:40:50.040096 11331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "e12c363ffb734666a927a6e547561c64"
format_stamp: "Formatted at 2026-08-07 22:40:50 on dist-test-slave-8w9v"
server_key: "1f3ed498d8585fd4b145a4706703a2dc"
server_key_iv: "65b0dc0ac252cbe98e2700cbae797d5d"
server_key_version: "encryptionkey@0"
I20260807 22:40:50.044724 11331 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:40:50.047436 11347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:50.049033 11331 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:50.049203 11331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "e12c363ffb734666a927a6e547561c64"
format_stamp: "Formatted at 2026-08-07 22:40:50 on dist-test-slave-8w9v"
server_key: "1f3ed498d8585fd4b145a4706703a2dc"
server_key_iv: "65b0dc0ac252cbe98e2700cbae797d5d"
server_key_version: "encryptionkey@0"
I20260807 22:40:50.049345 11331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:50.076040 11331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:50.079656 11331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:50.079834 11331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:50.080529 11331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:50.081384 11331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:50.081435 11331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:50.081478 11331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:50.081494 11331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:50.090999 11331 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:43259
I20260807 22:40:50.091018 11473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:43259 every 8 connection(s)
I20260807 22:40:50.091976 11331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:50.096024 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 11331
I20260807 22:40:50.096210 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:50.096555 26833 external_mini_cluster.cc:1428] Setting key 3514feb2f27275fe9b6f8e5a4d2988f6
Aug 07 22:40:50 dist-test-slave-8w9v krb5kdc[10929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142450, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:40:50.107441 11017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.094022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:52473 (local address 127.26.52.126:37831)
0807 22:40:50.094181 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.094185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.095070 (+ 885us) server_negotiation.cc:407] Connection header received
0807 22:40:50.096968 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.096972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.097040 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.097132 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.098677 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.099324 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.100528 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.100771 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.100873 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.103611 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.103614 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.103617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.103643 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.105202 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.105789 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.105792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.105793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.105878 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.106295 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.106299 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.106301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.106516 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.106614 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.107183 (+ 569us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.107310 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:40:50.108525 11477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.094437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:52473)
0807 22:40:50.094914 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.094961 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.096678 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.097339 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.097351 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.097910 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:50.098498 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.098514 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.099462 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.099465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.100396 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.100406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.100920 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.100923 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.101066 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.101708 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:50.101726 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:50.103424 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:50.105333 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:50.105339 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:50.105354 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:50.105658 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:50.106006 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:50.106009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:50.106010 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:50.106172 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:50.106655 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:50.106661 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:50.106936 (+ 275us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.107118 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.107410 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":131,"threads_started":1}
I20260807 22:40:50.110090 11474 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37831
I20260807 22:40:50.110400 11474 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:50.111133 11474 heartbeater.cc:511] Master 127.26.52.126:37831 requested a full tablet report, sending...
I20260807 22:40:50.112393 10977 ts_manager.cc:194] Registered new tserver with Master: e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259)
I20260807 22:40:50.113101 10977 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:52473
I20260807 22:40:50.123600 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:40:50.133622 11017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.125878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60100 (local address 127.26.52.126:37831)
0807 22:40:50.126024 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.126029 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.126274 (+ 245us) server_negotiation.cc:407] Connection header received
0807 22:40:50.126498 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.126501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.126561 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.126634 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.127477 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.128078 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.129016 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.129229 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.129311 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.130774 (+ 1463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.130778 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.130780 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.130804 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.132078 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.132530 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.132533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.132534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.132614 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.132859 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.132861 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.132862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.133084 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.133194 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.133395 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.133495 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 22:40:50.136885 10977 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:50.140010 10977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:50.155438 11490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.149368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41388 (local address 127.26.52.67:43259)
0807 22:40:50.149975 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.149993 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.150550 (+ 557us) server_negotiation.cc:407] Connection header received
0807 22:40:50.150709 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.150717 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.150892 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.151076 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.151296 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.152211 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.153973 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.154737 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.154880 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.155037 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.155173 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.155268 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":140,"threads_started":1}
I20260807 22:40:50.155421 11491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.149154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:43259 (local address 127.0.0.1:41388)
0807 22:40:50.150454 (+ 1300us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.150467 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.150568 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.151053 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.151057 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.151076 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.151178 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.151185 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.152334 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.152339 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.153856 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.153870 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.154873 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.154877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.154984 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.155021 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.155142 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.155267 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1238,"thread_start_us":110,"threads_started":1}
I20260807 22:40:50.155718 11487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.149074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:40697 (local address 127.0.0.1:36256)
0807 22:40:50.149956 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.150010 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.150151 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.150786 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.150795 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.150826 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.150987 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.150995 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.152925 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.152929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.154156 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.154165 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.155307 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.155311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.155405 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.155428 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.155484 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.155557 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"mutex_wait_us":43,"thread_start_us":103,"threads_started":1}
I20260807 22:40:50.155871 11488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.149830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38627 (local address 127.0.0.1:50010)
0807 22:40:50.150765 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.150778 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.150865 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.151358 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.151361 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.151380 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.151491 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.151498 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.152824 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.152828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.154269 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.154282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.155496 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.155499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.155586 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.155607 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.155670 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.155733 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":879,"mutex_wait_us":69,"thread_start_us":88,"threads_started":1}
I20260807 22:40:50.156417 11492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.150240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50010 (local address 127.26.52.65:38627)
0807 22:40:50.150671 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.150679 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.150960 (+ 281us) server_negotiation.cc:407] Connection header received
0807 22:40:50.151042 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.151050 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.151231 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.151374 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.151620 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.152681 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.154383 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.155161 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.155282 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.155420 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.156143 (+ 723us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.156260 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":140,"threads_started":1}
I20260807 22:40:50.157001 11489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.149162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36256 (local address 127.26.52.66:40697)
0807 22:40:50.150186 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.150198 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.150224 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:40:50.150311 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.150320 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.150563 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.150786 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.151118 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.152370 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.154341 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.155161 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.156439 (+ 1278us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.156737 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.156791 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.156878 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":922,"thread_start_us":131,"threads_started":1}
I20260807 22:40:50.158879 11403 tablet_service.cc:1467] Processing CreateTablet for tablet cc7c47d3edc047e69ce6fc29ec7ad60a (DEFAULT_TABLE table=test-table [id=27ff7176d4e2463d8e313948b52a3595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:50.159017 11113 tablet_service.cc:1467] Processing CreateTablet for tablet cc7c47d3edc047e69ce6fc29ec7ad60a (DEFAULT_TABLE table=test-table [id=27ff7176d4e2463d8e313948b52a3595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:50.159994 11113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7c47d3edc047e69ce6fc29ec7ad60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:50.160013 11403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7c47d3edc047e69ce6fc29ec7ad60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:50.161520 11258 tablet_service.cc:1467] Processing CreateTablet for tablet cc7c47d3edc047e69ce6fc29ec7ad60a (DEFAULT_TABLE table=test-table [id=27ff7176d4e2463d8e313948b52a3595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:50.162668 11258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7c47d3edc047e69ce6fc29ec7ad60a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:50.167296 11493 tablet_bootstrap.cc:492] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Bootstrap starting.
I20260807 22:40:50.169716 11493 tablet_bootstrap.cc:654] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:50.170449 11496 tablet_bootstrap.cc:492] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: Bootstrap starting.
I20260807 22:40:50.170523 11493 log.cc:824] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:50.171077 11494 tablet_bootstrap.cc:492] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: Bootstrap starting.
I20260807 22:40:50.173166 11493 tablet_bootstrap.cc:492] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: No bootstrap required, opened a new log
I20260807 22:40:50.173415 11493 ts_tablet_manager.cc:1397] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:40:50.173480 11496 tablet_bootstrap.cc:654] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:50.173697 11494 tablet_bootstrap.cc:654] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:50.174469 11494 log.cc:824] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:50.174470 11496 log.cc:824] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:50.176829 11494 tablet_bootstrap.cc:492] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: No bootstrap required, opened a new log
I20260807 22:40:50.176829 11496 tablet_bootstrap.cc:492] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: No bootstrap required, opened a new log
I20260807 22:40:50.177063 11494 ts_tablet_manager.cc:1397] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:40:50.177063 11496 ts_tablet_manager.cc:1397] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 22:40:50.177534 11493 raft_consensus.cc:348] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:40:50.177807 11493 raft_consensus.cc:374] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:50.177897 11493 raft_consensus.cc:729] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61e0a4f0e52f4cfb849e20e48cd00682, State: Initialized, Role: FOLLOWER
I20260807 22:40:50.178404 11493 consensus_queue.cc:260] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:40:50.179181 11187 heartbeater.cc:503] Master 127.26.52.126:37831 was elected leader, sending a full tablet report...
I20260807 22:40:50.179497 11493 ts_tablet_manager.cc:1428] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:40:50.181041 11494 raft_consensus.cc:348] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:40:50.181316 11494 raft_consensus.cc:374] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:50.181388 11494 raft_consensus.cc:729] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12c363ffb734666a927a6e547561c64, State: Initialized, Role: FOLLOWER
I20260807 22:40:50.181656 11496 raft_consensus.cc:348] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:40:50.182032 11496 raft_consensus.cc:374] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:50.181969 11494 consensus_queue.cc:260] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:40:50.182171 11496 raft_consensus.cc:729] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 028e8b3cd1b449dd83575f6e38859fef, State: Initialized, Role: FOLLOWER
I20260807 22:40:50.182654 11496 consensus_queue.cc:260] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:40:50.183135 11494 ts_tablet_manager.cc:1428] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:40:50.183400 11326 heartbeater.cc:503] Master 127.26.52.126:37831 was elected leader, sending a full tablet report...
I20260807 22:40:50.183658 11496 ts_tablet_manager.cc:1428] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 22:40:50.183657 11474 heartbeater.cc:503] Master 127.26.52.126:37831 was elected leader, sending a full tablet report...
I20260807 22:40:50.280620 11504 raft_consensus.cc:482] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:50.280882 11504 raft_consensus.cc:504] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:40:50.282151 11504 leader_election.cc:288] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697), 61e0a4f0e52f4cfb849e20e48cd00682 (127.26.52.65:38627)
I20260807 22:40:50.286119 11492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.282687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:60909 (local address 127.26.52.65:38627)
0807 22:40:50.282821 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.282825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.282840 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:40:50.282985 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.282988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.283031 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.283120 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.283398 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.284035 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.285119 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.285535 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.285663 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.285720 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.285906 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.285989 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:40:50.286119 11477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.282544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38627 (local address 127.26.52.67:60909)
0807 22:40:50.282693 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.282711 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.282842 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.283133 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.283136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.283155 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.283285 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.283291 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.284175 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.284178 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.284992 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.285001 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.285664 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.285667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.285773 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.285798 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.285888 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.285967 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":20}
I20260807 22:40:50.286614 11489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.282674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:60181 (local address 127.26.52.66:40697)
0807 22:40:50.282846 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.282852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.283223 (+ 371us) server_negotiation.cc:407] Connection header received
0807 22:40:50.283391 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.283394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.283447 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.283542 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.283857 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.284423 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.285548 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.285994 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.286144 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.286196 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.286401 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.286476 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:40:50.286873 11135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7c47d3edc047e69ce6fc29ec7ad60a" candidate_uuid: "e12c363ffb734666a927a6e547561c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" is_pre_election: true
I20260807 22:40:50.286989 11506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.282544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:40697 (local address 127.26.52.67:60181)
0807 22:40:50.283110 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.283123 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.283263 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.283552 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.283555 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.283571 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.283698 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.283704 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.284545 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.284549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.285419 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.285429 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.286145 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.286148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.286246 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.286272 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.286797 (+ 525us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.286879 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"mutex_wait_us":154,"thread_start_us":156,"threads_started":1}
I20260807 22:40:50.287231 11135 raft_consensus.cc:2454] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12c363ffb734666a927a6e547561c64 in term 0.
I20260807 22:40:50.287707 11278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7c47d3edc047e69ce6fc29ec7ad60a" candidate_uuid: "e12c363ffb734666a927a6e547561c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "028e8b3cd1b449dd83575f6e38859fef" is_pre_election: true
I20260807 22:40:50.287771 11348 leader_election.cc:302] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e0a4f0e52f4cfb849e20e48cd00682, e12c363ffb734666a927a6e547561c64; no voters:
I20260807 22:40:50.288031 11278 raft_consensus.cc:2454] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12c363ffb734666a927a6e547561c64 in term 0.
I20260807 22:40:50.288094 11504 raft_consensus.cc:2781] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:50.288239 11504 raft_consensus.cc:482] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:50.288300 11504 raft_consensus.cc:3037] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:50.289443 11504 raft_consensus.cc:504] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:40:50.289829 11504 leader_election.cc:288] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [CANDIDATE]: Term 1 election: Requested vote from peers 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697), 61e0a4f0e52f4cfb849e20e48cd00682 (127.26.52.65:38627)
I20260807 22:40:50.290307 11135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7c47d3edc047e69ce6fc29ec7ad60a" candidate_uuid: "e12c363ffb734666a927a6e547561c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e0a4f0e52f4cfb849e20e48cd00682"
I20260807 22:40:50.290354 11278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7c47d3edc047e69ce6fc29ec7ad60a" candidate_uuid: "e12c363ffb734666a927a6e547561c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "028e8b3cd1b449dd83575f6e38859fef"
I20260807 22:40:50.290428 11135 raft_consensus.cc:3037] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:50.290519 11278 raft_consensus.cc:3037] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:50.291590 11135 raft_consensus.cc:2454] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12c363ffb734666a927a6e547561c64 in term 1.
I20260807 22:40:50.291608 11278 raft_consensus.cc:2454] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12c363ffb734666a927a6e547561c64 in term 1.
I20260807 22:40:50.292004 11349 leader_election.cc:302] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 028e8b3cd1b449dd83575f6e38859fef, e12c363ffb734666a927a6e547561c64; no voters:
I20260807 22:40:50.292261 11504 raft_consensus.cc:2781] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:50.292524 11504 raft_consensus.cc:686] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 1 LEADER]: Becoming Leader. State: Replica: e12c363ffb734666a927a6e547561c64, State: Running, Role: LEADER
I20260807 22:40:50.292878 11504 consensus_queue.cc:237] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:40:50.296595 10977 catalog_manager.cc:5495] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12c363ffb734666a927a6e547561c64 (127.26.52.67). New cstate: current_term: 1 leader_uuid: "e12c363ffb734666a927a6e547561c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:50.314718 11490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.310337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41400 (local address 127.26.52.67:43259)
0807 22:40:50.310507 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.310511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.310536 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:40:50.310663 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.310667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.310738 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.310855 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:50.311086 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.311899 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.312854 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.313227 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.313335 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.313700 (+ 365us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:50.314296 (+ 596us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:50.314418 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.314493 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.314564 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 22:40:50.321163 11135 raft_consensus.cc:1261] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Refusing update from remote peer e12c363ffb734666a927a6e547561c64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:50.321163 11278 raft_consensus.cc:1261] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef [term 1 FOLLOWER]: Refusing update from remote peer e12c363ffb734666a927a6e547561c64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:50.322034 11509 consensus_queue.cc:1035] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:50.322252 11504 consensus_queue.cc:1035] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:50.340354 10977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:50.340576 10977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:50.343617 10977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Sending DeleteTablet for 3 replicas of tablet cc7c47d3edc047e69ce6fc29ec7ad60a
I20260807 22:40:50.344820 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 11044
I20260807 22:40:50.344789 11113 tablet_service.cc:1514] Processing DeleteTablet for tablet cc7c47d3edc047e69ce6fc29ec7ad60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:50 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:50010
I20260807 22:40:50.345013 11403 tablet_service.cc:1514] Processing DeleteTablet for tablet cc7c47d3edc047e69ce6fc29ec7ad60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:50 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:41388
I20260807 22:40:50.345587 11258 tablet_service.cc:1514] Processing DeleteTablet for tablet cc7c47d3edc047e69ce6fc29ec7ad60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:50 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:36256
I20260807 22:40:50.346454 11523 tablet_replica.cc:330] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: stopping tablet replica
I20260807 22:40:50.346913 11523 raft_consensus.cc:2229] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:50.347391 11523 raft_consensus.cc:2258] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:50.348378 11522 tablet_replica.cc:330] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: stopping tablet replica
I20260807 22:40:50.348820 11522 raft_consensus.cc:2229] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:50.349300 11522 raft_consensus.cc:2258] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:50.349515 11523 ts_tablet_manager.cc:1905] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:50.350993 11522 ts_tablet_manager.cc:1905] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:50.352839 11523 ts_tablet_manager.cc:1918] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:50.353080 11523 log.cc:1196] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/cc7c47d3edc047e69ce6fc29ec7ad60a
I20260807 22:40:50.353953 11523 ts_tablet_manager.cc:1939] T cc7c47d3edc047e69ce6fc29ec7ad60a P 028e8b3cd1b449dd83575f6e38859fef: Deleting consensus metadata
I20260807 22:40:50.355082 11522 ts_tablet_manager.cc:1918] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:50.355289 11522 log.cc:1196] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/cc7c47d3edc047e69ce6fc29ec7ad60a
I20260807 22:40:50.355755 11522 ts_tablet_manager.cc:1939] T cc7c47d3edc047e69ce6fc29ec7ad60a P e12c363ffb734666a927a6e547561c64: Deleting consensus metadata
I20260807 22:40:50.356073 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 11192
I20260807 22:40:50.356079 10962 catalog_manager.cc:4841] TS 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697): tablet cc7c47d3edc047e69ce6fc29ec7ad60a (table test-table [id=27ff7176d4e2463d8e313948b52a3595]) successfully deleted
W20260807 22:40:50.356093 10961 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:38627 (error 108)
I20260807 22:40:50.359699 11488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.359275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38627 (local address 127.0.0.1:50014)
0807 22:40:50.359470 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.359572 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:38627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 22:40:50.360088 10961 catalog_manager.cc:4584] TS 61e0a4f0e52f4cfb849e20e48cd00682 (127.26.52.65:38627): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cc7c47d3edc047e69ce6fc29ec7ad60a: Network error: Client connection negotiation failed: client connection to 127.26.52.65:38627: connect: Connection refused (error 111)
I20260807 22:40:50.361099 10964 catalog_manager.cc:4841] TS e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259): tablet cc7c47d3edc047e69ce6fc29ec7ad60a (table test-table [id=27ff7176d4e2463d8e313948b52a3595]) successfully deleted
I20260807 22:40:50.365272 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 11331
I20260807 22:40:50.375865 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 10944
I20260807 22:41:10.386011 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37831
--webserver_interface=127.26.52.126
--webserver_port=36741
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:37831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:10.508070 11526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:10.508419 11526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:10.508464 11526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:10.512712 11526 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 22:41:10.512768 11526 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 22:41:10.512785 11526 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 22:41:10.512799 11526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:10.512818 11526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:10.512893 11526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:10.512924 11526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:10.512953 11526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:10.518713 11526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:37831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=36741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:10.519944 11526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:10.521090 11526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:10.536260 11533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:10.536357 11526 server_base.cc:1034] running on GCE node
W20260807 22:41:10.536293 11535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:10.536260 11532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:10.537199 11526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:10.538467 11526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:10.539649 11526 hybrid_clock.cc:648] HybridClock initialized: now 1786142470539623 us; error 40 us; skew 500 ppm
Aug 07 22:41:10 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142470, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:10.546289 11526 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:41:10.547396 11526 webserver.cc:460] Webserver started at http://127.26.52.126:36741/ using document root <none> and password file <none>
I20260807 22:41:10.548081 11526 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:10.548228 11526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:10.552543 11526 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:41:10.554991 11542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:10.556479 11526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:41:10.556643 11526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "83b6c12821374e1a9cdb40836091d100"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "6262b0a8b0c470a23713f91c66c327e1"
server_key_iv: "e53db029c1587d2ace67fd7efbde937e"
server_key_version: "encryptionkey@0"
I20260807 22:41:10.557305 11526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:10.572104 11526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:10.575842 11526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:10.576107 11526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:10.584447 11526 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:37831
I20260807 22:41:10.584807 11598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:37831 every 8 connection(s)
I20260807 22:41:10.585685 11526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:10.590379 11599 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:41:10.592239 11599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Bootstrap starting.
I20260807 22:41:10.595019 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 11526
I20260807 22:41:10.595486 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:38627
--local_ip_for_outbound_sockets=127.26.52.65
--tserver_master_addrs=127.26.52.126:37831
--webserver_port=45737
--webserver_interface=127.26.52.65
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:41:10.611008 11599 log.cc:824] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:10.620821 11599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:41:10.621272 11599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Bootstrap complete.
I20260807 22:41:10.626258 11599 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:41:10.626745 11599 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83b6c12821374e1a9cdb40836091d100, State: Initialized, Role: FOLLOWER
I20260807 22:41:10.627264 11599 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:41:10.627424 11599 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:10.627529 11599 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:10.627646 11599 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:41:10.629799 11599 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:41:10.630162 11599 leader_election.cc:302] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83b6c12821374e1a9cdb40836091d100; no voters:
I20260807 22:41:10.630548 11599 leader_election.cc:288] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:41:10.630677 11603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:41:10.630892 11603 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 2 LEADER]: Becoming Leader. State: Replica: 83b6c12821374e1a9cdb40836091d100, State: Running, Role: LEADER
I20260807 22:41:10.631273 11603 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:41:10.631922 11599 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:10.632344 11603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83b6c12821374e1a9cdb40836091d100. Latest consensus state: current_term: 2 leader_uuid: "83b6c12821374e1a9cdb40836091d100" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } } }
I20260807 22:41:10.632547 11603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:10.632812 11605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "83b6c12821374e1a9cdb40836091d100" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } } }
I20260807 22:41:10.633024 11605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:10.637051 11619 catalog_manager.cc:1259] Loaded cluster ID: 2abbd27b4e9f4ab39240af6054a8d16a
I20260807 22:41:10.637144 11619 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: loading cluster ID for follower catalog manager: success
I20260807 22:41:10.638952 11619 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: acquiring CA information for follower catalog manager: success
I20260807 22:41:10.640300 11619 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:41:10.640441 11608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:10.642506 11608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:10.642982 11608 catalog_manager.cc:1259] Loaded cluster ID: 2abbd27b4e9f4ab39240af6054a8d16a
I20260807 22:41:10.643057 11608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:10.643664 11608 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:10.644093 11608 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Loaded TSK: 0
I20260807 22:41:10.654351 11608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Generated new TSK 1
I20260807 22:41:10.654660 11608 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:41:10.735159 11601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:10.735440 11601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:10.735486 11601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:10.739773 11601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:10.739859 11601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:10.739924 11601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:41:10.747679 11601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:38627
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=45737
--tserver_master_addrs=127.26.52.126:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:10.749420 11601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:10.751042 11601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:10.764828 11628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:10.764896 11629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:10.765389 11631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:10.765563 11601 server_base.cc:1034] running on GCE node
I20260807 22:41:10.766232 11601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:10.767190 11601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:10.770190 11601 hybrid_clock.cc:648] HybridClock initialized: now 1786142470770139 us; error 54 us; skew 500 ppm
Aug 07 22:41:10 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142470, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:10.774528 11601 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:41:10.775950 11601 webserver.cc:460] Webserver started at http://127.26.52.65:45737/ using document root <none> and password file <none>
I20260807 22:41:10.776834 11601 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:10.776961 11601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:10.782645 11601 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:41:10.785786 11638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:10.787472 11601 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:41:10.787642 11601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "61e0a4f0e52f4cfb849e20e48cd00682"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "e53de9427f5f65ef0dddca154592d4b9"
server_key_iv: "20b0a2ed459615132efac2a3fb1d4fe7"
server_key_version: "encryptionkey@0"
I20260807 22:41:10.788407 11601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:10.814030 11601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:10.819159 11601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:10.819433 11601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:10.820206 11601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:10.821470 11647 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:41:10.826490 11601 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:41:10.826710 11601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260807 22:41:10.826846 11601 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:41:10.829265 11601 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:41:10.829388 11601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20260807 22:41:10.829751 11647 tablet_bootstrap.cc:492] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Bootstrap starting.
I20260807 22:41:10.841846 11601 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:38627
I20260807 22:41:10.841990 11760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:38627 every 8 connection(s)
I20260807 22:41:10.843021 11601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:10.846196 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 11601
I20260807 22:41:10.846776 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:40697
--local_ip_for_outbound_sockets=127.26.52.66
--tserver_master_addrs=127.26.52.126:37831
--webserver_port=36559
--webserver_interface=127.26.52.66
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:41:10.850298 11647 log.cc:824] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:41:10 dist-test-slave-8w9v krb5kdc[10929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142470, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:10.860280 11647 tablet_bootstrap.cc:492] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:41:10.860875 11647 tablet_bootstrap.cc:492] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Bootstrap complete.
I20260807 22:41:10.862250 11647 ts_tablet_manager.cc:1397] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Time spent bootstrapping tablet: real 0.033s user 0.029s sys 0.000s
I20260807 22:41:10.865392 11647 raft_consensus.cc:348] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:10.865973 11647 raft_consensus.cc:729] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61e0a4f0e52f4cfb849e20e48cd00682, State: Initialized, Role: FOLLOWER
I20260807 22:41:10.866103 11764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:10.845686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:39021)
0807 22:41:10.846839 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:10.846903 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:10.848315 (+ 1412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:10.850048 (+ 1733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:10.850055 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:10.850512 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:10.851156 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:10.851181 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.853371 (+ 2190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.853375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:10.854706 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:10.854718 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.855901 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.855906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:10.856152 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:10.856954 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:10.856978 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:10.859185 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:10.862281 (+ 3096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:10.862288 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:10.862304 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:10.862722 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:10.863169 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:10.863173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:10.863175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:10.863370 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:10.864107 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:10.864114 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:10.864466 (+ 352us) client_negotiation.cc:769] Sending connection context
0807 22:41:10.864694 (+ 228us) client_negotiation.cc:240] Negotiation successful
0807 22:41:10.865065 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":916,"thread_start_us":232,"threads_started":1}
I20260807 22:41:10.866467 11763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:10.845684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:39021 (local address 127.26.52.126:37831)
0807 22:41:10.846401 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:10.846428 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:10.847047 (+ 619us) server_negotiation.cc:407] Connection header received
0807 22:41:10.848860 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:10.848877 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:10.849305 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:10.849655 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:10.851402 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.853166 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.854872 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.855713 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.855934 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:10.859512 (+ 3578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:10.859524 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:10.859545 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:10.859595 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:10.862131 (+ 2536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:10.862869 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:10.862876 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:10.862881 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:10.863046 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:10.863486 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:10.863489 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:10.863491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:10.863971 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:10.864108 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:10.864831 (+ 723us) server_negotiation.cc:299] Negotiation successful
0807 22:41:10.865149 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":189,"threads_started":1}
I20260807 22:41:10.866519 11647 consensus_queue.cc:260] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:10.867686 11647 ts_tablet_manager.cc:1428] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260807 22:41:10.869079 11761 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37831
I20260807 22:41:10.869392 11761 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:10.869943 11761 heartbeater.cc:511] Master 127.26.52.126:37831 requested a full tablet report, sending...
I20260807 22:41:10.872629 11562 ts_manager.cc:194] Registered new tserver with Master: 61e0a4f0e52f4cfb849e20e48cd00682 (127.26.52.65:38627)
I20260807 22:41:10.876787 11562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:39021
I20260807 22:41:10.879659 11761 heartbeater.cc:503] Master 127.26.52.126:37831 was elected leader, sending a full tablet report...
Aug 07 22:41:10 dist-test-slave-8w9v krb5kdc[10929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142470, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.65@KRBTEST.COM
I20260807 22:41:10.886754 11768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:10.875499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38627 (local address 127.0.0.1:51666)
0807 22:41:10.875982 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:10.876033 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:10.876212 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:10.876862 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:10.876868 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:10.877456 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:10.877599 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:10.877611 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.878673 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.878679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:10.879297 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:10.879306 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.880260 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.880265 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:10.880384 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:10.881094 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:10.881110 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:10.882707 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:10.884806 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:10.884817 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:10.884823 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:10.885086 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:10.885428 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:10.885431 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:10.885433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:10.885527 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:10.886022 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:10.886029 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:10.886169 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 22:41:10.886317 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 22:41:10.886549 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":145,"threads_started":1}
I20260807 22:41:10.886754 11769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:10.875612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51666 (local address 127.26.52.65:38627)
0807 22:41:10.876375 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:10.876385 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:10.876411 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:41:10.876484 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:10.876490 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:10.876689 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:10.876931 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:10.877750 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.878544 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.879434 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.879994 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.880124 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:10.882873 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:10.882883 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:10.882893 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:10.882917 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:10.884677 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:10.885222 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:10.885228 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:10.885229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:10.885313 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:10.885621 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:10.885626 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:10.885627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:10.885900 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:10.886052 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:10.886413 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 22:41:10.886586 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":111,"threads_started":1}
I20260807 22:41:10.887845 11693 tablet_service.cc:1514] Processing DeleteTablet for tablet cc7c47d3edc047e69ce6fc29ec7ad60a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:50 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:51666
I20260807 22:41:10.888877 11770 tablet_replica.cc:330] stopping tablet replica
I20260807 22:41:10.889262 11770 raft_consensus.cc:2229] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:10.889554 11770 raft_consensus.cc:2258] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:10.890779 11770 ts_tablet_manager.cc:1905] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:10.895782 11770 ts_tablet_manager.cc:1918] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:10.895902 11770 log.cc:1196] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal/wals/cc7c47d3edc047e69ce6fc29ec7ad60a
I20260807 22:41:10.896323 11770 ts_tablet_manager.cc:1939] T cc7c47d3edc047e69ce6fc29ec7ad60a P 61e0a4f0e52f4cfb849e20e48cd00682: Deleting consensus metadata
I20260807 22:41:10.898504 11543 catalog_manager.cc:4841] TS 61e0a4f0e52f4cfb849e20e48cd00682 (127.26.52.65:38627): tablet cc7c47d3edc047e69ce6fc29ec7ad60a (table test-table [id=27ff7176d4e2463d8e313948b52a3595]) successfully deleted
W20260807 22:41:10.977351 11765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:10.977643 11765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:10.977723 11765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:10.981964 11765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:10.982056 11765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:10.982156 11765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:41:10.988344 11765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:40697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=36559
--tserver_master_addrs=127.26.52.126:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:10.989575 11765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:10.990674 11765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:11.001091 11776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:11.001091 11780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:11.001091 11778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:11.001166 11765 server_base.cc:1034] running on GCE node
I20260807 22:41:11.001807 11765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:11.002522 11765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:11.003697 11765 hybrid_clock.cc:648] HybridClock initialized: now 1786142471003657 us; error 53 us; skew 500 ppm
Aug 07 22:41:11 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142471, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:11.006711 11765 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:41:11.007647 11765 webserver.cc:460] Webserver started at http://127.26.52.66:36559/ using document root <none> and password file <none>
I20260807 22:41:11.008294 11765 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:11.008376 11765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:11.012423 11765 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:41:11.014600 11787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:11.015913 11765 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:41:11.016079 11765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "028e8b3cd1b449dd83575f6e38859fef"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "b70ec01fdb4d4279c30377cc5fee0c9f"
server_key_iv: "698eb63694276808b6ee410d5fd5c658"
server_key_version: "encryptionkey@0"
I20260807 22:41:11.016705 11765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:11.031893 11765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:11.035545 11765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:11.035761 11765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:11.036489 11765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:11.037350 11765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:11.037398 11765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:11.037477 11765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:11.037518 11765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:11.047267 11765 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:40697
I20260807 22:41:11.047295 11908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:40697 every 8 connection(s)
I20260807 22:41:11.048404 11765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:11.055943 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 11765
I20260807 22:41:11.056473 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:43259
--local_ip_for_outbound_sockets=127.26.52.67
--tserver_master_addrs=127.26.52.126:37831
--webserver_port=46817
--webserver_interface=127.26.52.67
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:41:11 dist-test-slave-8w9v krb5kdc[10929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142471, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:11.064000 11763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.050316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:34863 (local address 127.26.52.126:37831)
0807 22:41:11.050480 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.050483 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.051336 (+ 853us) server_negotiation.cc:407] Connection header received
0807 22:41:11.052743 (+ 1407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.052746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.052816 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.052941 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:11.054195 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.054765 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.055951 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.056323 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.056448 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.059536 (+ 3088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:11.059543 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:11.059548 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:11.059589 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:11.061646 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:11.062323 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:11.062326 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:11.062327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:11.062414 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:11.062782 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:11.062786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:11.062789 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:11.062997 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:11.063107 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:11.063653 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 22:41:11.063808 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:41:11.064904 11912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.050704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:34863)
0807 22:41:11.051172 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:11.051217 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:11.052510 (+ 1293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:11.053122 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:11.053129 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:11.053522 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:11.054032 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.054047 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.054903 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.054910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.055806 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.055816 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.056500 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.056505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.056769 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.057446 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:11.057463 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:11.059295 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:11.061794 (+ 2499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:11.061800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:11.061815 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:11.062177 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:11.062517 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:11.062520 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:11.062522 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:11.062679 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:11.063109 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:11.063118 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:11.063401 (+ 283us) client_negotiation.cc:769] Sending connection context
0807 22:41:11.063609 (+ 208us) client_negotiation.cc:240] Negotiation successful
0807 22:41:11.063976 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":127,"threads_started":1}
I20260807 22:41:11.066334 11909 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37831
I20260807 22:41:11.066596 11909 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:11.067124 11909 heartbeater.cc:511] Master 127.26.52.126:37831 requested a full tablet report, sending...
I20260807 22:41:11.068384 11562 ts_manager.cc:194] Registered new tserver with Master: 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697)
I20260807 22:41:11.068986 11562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:34863
W20260807 22:41:11.180861 11913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:11.181169 11913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:11.181250 11913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:11.185541 11913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:11.185612 11913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:11.185704 11913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:41:11.191390 11913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:43259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=46817
--tserver_master_addrs=127.26.52.126:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:11.192672 11913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:11.193869 11913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:11.204248 11919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:11.204463 11913 server_base.cc:1034] running on GCE node
W20260807 22:41:11.204254 11921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:11.204300 11918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:11.205124 11913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:11.205935 11913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:11.207142 11913 hybrid_clock.cc:648] HybridClock initialized: now 1786142471207114 us; error 40 us; skew 500 ppm
Aug 07 22:41:11 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142471, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:11.210064 11913 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:41:11.211078 11913 webserver.cc:460] Webserver started at http://127.26.52.67:46817/ using document root <none> and password file <none>
I20260807 22:41:11.211719 11913 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:11.211849 11913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:11.216020 11913 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:41:11.218384 11929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:11.220043 11913 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:41:11.220229 11913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "e12c363ffb734666a927a6e547561c64"
format_stamp: "Formatted at 2026-08-07 22:40:50 on dist-test-slave-8w9v"
server_key: "1f3ed498d8585fd4b145a4706703a2dc"
server_key_iv: "65b0dc0ac252cbe98e2700cbae797d5d"
server_key_version: "encryptionkey@0"
I20260807 22:41:11.220829 11913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:11.234397 11913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:11.237771 11913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:11.237999 11913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:11.238677 11913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:11.239590 11913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:11.239665 11913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:11.239738 11913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:11.239792 11913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:11.249629 11913 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:43259
I20260807 22:41:11.249647 12049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:43259 every 8 connection(s)
I20260807 22:41:11.250731 11913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:11.255927 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 11913
Aug 07 22:41:11 dist-test-slave-8w9v krb5kdc[10929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142471, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:11.266741 12054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.256838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52886 (local address 127.26.52.126:37831)
0807 22:41:11.257479 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.257483 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.257495 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:41:11.257528 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.257530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.257566 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.257644 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:11.258522 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.259385 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.260547 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.260771 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.260876 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.262251 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:11.262255 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:11.262260 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:11.262288 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:11.264596 (+ 2308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:11.265130 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:11.265133 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:11.265134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:11.265212 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:11.265598 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:11.265602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:11.265604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:11.265881 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:11.266123 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:11.266366 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 22:41:11.266508 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":145,"threads_started":1}
I20260807 22:41:11.267997 11763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.252921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:54557 (local address 127.26.52.126:37831)
0807 22:41:11.253095 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.253101 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.254081 (+ 980us) server_negotiation.cc:407] Connection header received
0807 22:41:11.255474 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.255478 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.255541 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.255656 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:11.257218 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.257852 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.259618 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.259960 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.260067 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.263366 (+ 3299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:11.263369 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:11.263371 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:11.263411 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:11.265412 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:11.266134 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:11.266137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:11.266139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:11.266239 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:11.266689 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:11.266698 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:11.266700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:11.266941 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:11.267040 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:11.267760 (+ 720us) server_negotiation.cc:299] Negotiation successful
0807 22:41:11.267888 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 22:41:11.269181 12052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.253362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:54557)
0807 22:41:11.253867 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:11.253949 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:11.255232 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:11.255847 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:11.255854 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:11.256338 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:11.257051 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.257082 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.258017 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.258020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.259484 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.259497 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.260189 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.260194 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.260368 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.261172 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:11.261201 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:11.263169 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:11.265607 (+ 2438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:11.265615 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:11.265634 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:11.266026 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:11.266341 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:11.266345 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:11.266347 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:11.266547 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:11.267062 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:11.267069 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:11.267453 (+ 384us) client_negotiation.cc:769] Sending connection context
0807 22:41:11.267684 (+ 231us) client_negotiation.cc:240] Negotiation successful
0807 22:41:11.268095 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":145,"threads_started":1}
I20260807 22:41:11.270270 12050 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37831
I20260807 22:41:11.270550 12050 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:11.271096 12050 heartbeater.cc:511] Master 127.26.52.126:37831 requested a full tablet report, sending...
I20260807 22:41:11.272264 11562 ts_manager.cc:194] Registered new tserver with Master: e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259)
I20260807 22:41:11.272830 11562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:54557
I20260807 22:41:11.281261 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:41:11.285740 11763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.281967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52888 (local address 127.26.52.126:37831)
0807 22:41:11.282138 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.282143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.282389 (+ 246us) server_negotiation.cc:407] Connection header received
0807 22:41:11.282554 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.282556 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.282671 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.282763 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:41:11.282989 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.283506 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.284474 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.284695 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.284782 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.285102 (+ 320us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:41:11.285340 (+ 238us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 22:41:11.285579 (+ 239us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52888: token expired
Metrics: {"server-negotiator.queue_time_us":62}
W20260807 22:41:11.285836 11763 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52888: token expired
W20260807 22:41:11.286191 11478 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.52.126:37831)
I20260807 22:41:11.293962 11763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.286603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52900 (local address 127.26.52.126:37831)
0807 22:41:11.286725 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.286728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.286741 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:41:11.286836 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.286838 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.286877 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.286940 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:11.287549 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.288029 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.288839 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.289042 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.289120 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.290502 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:11.290506 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:11.290508 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:11.290534 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:11.292185 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:11.292690 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:11.292692 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:11.292693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:11.292833 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:11.293093 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:11.293095 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:11.293096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:11.293278 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:11.293405 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:11.293636 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 22:41:11.293740 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:41:11.296784 11562 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52900:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:41:11.300267 11562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:41:11.308676 11693 tablet_service.cc:1467] Processing CreateTablet for tablet 3821c669ad6f48b8936352343ab8782d (DEFAULT_TABLE table=test-table [id=71eba6c202a24559aee09def511a9396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:11.309429 11693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3821c669ad6f48b8936352343ab8782d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:11.312234 11647 tablet_bootstrap.cc:492] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Bootstrap starting.
I20260807 22:41:11.313202 11647 tablet_bootstrap.cc:654] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:11.314061 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.307741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:43259 (local address 127.0.0.1:54008)
0807 22:41:11.308085 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:11.308100 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:11.308215 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:11.309050 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:11.309056 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:11.309079 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:11.309196 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.309206 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.310663 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.310666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.312169 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.312182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.313562 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.313566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.313661 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.313711 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 22:41:11.313810 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 22:41:11.313899 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":56,"thread_start_us":125,"threads_started":1}
I20260807 22:41:11.314076 12062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.308231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54008 (local address 127.26.52.67:43259)
0807 22:41:11.308601 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.308617 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.308639 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:41:11.308715 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.308720 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.308887 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.309356 (+ 469us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:11.309578 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.310543 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.312576 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.313429 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.313542 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.313707 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:11.313842 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 22:41:11.313948 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":144,"threads_started":1}
I20260807 22:41:11.314456 11768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.307491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:40697 (local address 127.0.0.1:51660)
0807 22:41:11.307686 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:11.307702 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:11.307780 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:11.308871 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:11.308875 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:11.308895 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:11.309010 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.309016 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.310771 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.310774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.312169 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.312182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.313988 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.313992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.314116 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.314141 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:41:11.314200 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 22:41:11.314307 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":101}
I20260807 22:41:11.314890 11647 tablet_bootstrap.cc:492] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: No bootstrap required, opened a new log
I20260807 22:41:11.314991 11647 ts_tablet_manager.cc:1397] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:41:11.315116 12061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.307752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51660 (local address 127.26.52.66:40697)
0807 22:41:11.308266 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.308283 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.308308 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:41:11.308392 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.308425 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.308680 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.308853 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:11.309164 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.310610 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.312806 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.313824 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.314643 (+ 819us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.314795 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:11.314853 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 22:41:11.314961 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":135,"threads_started":1}
I20260807 22:41:11.315500 11647 raft_consensus.cc:348] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:11.315634 11647 raft_consensus.cc:374] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:11.315672 11647 raft_consensus.cc:729] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61e0a4f0e52f4cfb849e20e48cd00682, State: Initialized, Role: FOLLOWER
I20260807 22:41:11.315821 11647 consensus_queue.cc:260] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:11.316144 11647 ts_tablet_manager.cc:1428] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 22:41:11.317505 11980 tablet_service.cc:1467] Processing CreateTablet for tablet 3821c669ad6f48b8936352343ab8782d (DEFAULT_TABLE table=test-table [id=71eba6c202a24559aee09def511a9396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:11.317830 11840 tablet_service.cc:1467] Processing CreateTablet for tablet 3821c669ad6f48b8936352343ab8782d (DEFAULT_TABLE table=test-table [id=71eba6c202a24559aee09def511a9396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:11.318723 11840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3821c669ad6f48b8936352343ab8782d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:11.318732 11980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3821c669ad6f48b8936352343ab8782d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:11.327644 12065 tablet_bootstrap.cc:492] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: Bootstrap starting.
I20260807 22:41:11.329895 12065 tablet_bootstrap.cc:654] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:11.331038 12065 log.cc:824] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:11.331851 12064 tablet_bootstrap.cc:492] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: Bootstrap starting.
I20260807 22:41:11.333616 12065 tablet_bootstrap.cc:492] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: No bootstrap required, opened a new log
I20260807 22:41:11.333842 12065 ts_tablet_manager.cc:1397] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:41:11.334939 12064 tablet_bootstrap.cc:654] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:11.335718 12064 log.cc:824] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:11.337131 12065 raft_consensus.cc:348] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:11.337376 12065 raft_consensus.cc:374] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:11.337436 12065 raft_consensus.cc:729] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12c363ffb734666a927a6e547561c64, State: Initialized, Role: FOLLOWER
I20260807 22:41:11.337924 12064 tablet_bootstrap.cc:492] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: No bootstrap required, opened a new log
I20260807 22:41:11.337961 12065 consensus_queue.cc:260] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:11.338168 12064 ts_tablet_manager.cc:1397] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260807 22:41:11.338800 12050 heartbeater.cc:503] Master 127.26.52.126:37831 was elected leader, sending a full tablet report...
I20260807 22:41:11.339138 12065 ts_tablet_manager.cc:1428] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: Time spent starting tablet: real 0.005s user 0.003s sys 0.004s
I20260807 22:41:11.343092 12064 raft_consensus.cc:348] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:11.343420 12064 raft_consensus.cc:374] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:11.343498 12064 raft_consensus.cc:729] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 028e8b3cd1b449dd83575f6e38859fef, State: Initialized, Role: FOLLOWER
I20260807 22:41:11.344054 12064 consensus_queue.cc:260] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
W20260807 22:41:11.344372 11762 tablet.cc:2369] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:41:11.344900 11909 heartbeater.cc:503] Master 127.26.52.126:37831 was elected leader, sending a full tablet report...
I20260807 22:41:11.345270 12064 ts_tablet_manager.cc:1428] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
W20260807 22:41:11.501773 12051 tablet.cc:2369] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:41:11.549640 11910 tablet.cc:2369] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:41:11.701108 12068 raft_consensus.cc:482] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:11.701342 12068 raft_consensus.cc:504] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:11.702546 12068 leader_election.cc:288] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697), 61e0a4f0e52f4cfb849e20e48cd00682 (127.26.52.65:38627)
I20260807 22:41:11.706749 12061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.702914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:37807 (local address 127.26.52.66:40697)
0807 22:41:11.703044 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.703049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.703071 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:41:11.703255 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.703260 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.703330 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.703436 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:11.703693 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.704410 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.705645 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.706223 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.706317 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.706360 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:11.706591 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 22:41:11.706645 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:41:11.706775 12052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.702836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:40697 (local address 127.26.52.67:37807)
0807 22:41:11.702975 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:11.702992 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:11.703088 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:11.703450 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:11.703452 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:11.703470 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:11.703576 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.703581 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.704527 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.704530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.705513 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.705523 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.706341 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.706344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.706456 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.706483 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:41:11.706563 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:41:11.706633 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 22:41:11.707480 12071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.702835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38627 (local address 127.26.52.67:58209)
0807 22:41:11.703564 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:11.703586 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:11.703699 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:11.703994 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:11.703997 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:11.704015 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:11.704158 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.704165 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.705071 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.705073 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.706009 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.706020 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.707052 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.707055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.707154 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.707177 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:41:11.707260 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 22:41:11.707332 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"mutex_wait_us":333,"thread_start_us":89,"threads_started":1}
I20260807 22:41:11.707495 12070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.702963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:58209 (local address 127.26.52.65:38627)
0807 22:41:11.703283 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.703286 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.703678 (+ 392us) server_negotiation.cc:407] Connection header received
0807 22:41:11.703803 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.703805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.703859 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.703953 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:11.704264 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.704954 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.706141 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.706781 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.706905 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.707082 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:11.707295 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 22:41:11.707376 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":114,"threads_started":1}
I20260807 22:41:11.707510 11860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3821c669ad6f48b8936352343ab8782d" candidate_uuid: "e12c363ffb734666a927a6e547561c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "028e8b3cd1b449dd83575f6e38859fef" is_pre_election: true
I20260807 22:41:11.707890 11860 raft_consensus.cc:2454] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12c363ffb734666a927a6e547561c64 in term 0.
I20260807 22:41:11.708105 11713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3821c669ad6f48b8936352343ab8782d" candidate_uuid: "e12c363ffb734666a927a6e547561c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" is_pre_election: true
I20260807 22:41:11.708428 11713 raft_consensus.cc:2454] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12c363ffb734666a927a6e547561c64 in term 0.
I20260807 22:41:11.708580 11931 leader_election.cc:302] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 028e8b3cd1b449dd83575f6e38859fef, e12c363ffb734666a927a6e547561c64; no voters:
I20260807 22:41:11.708901 12068 raft_consensus.cc:2781] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:41:11.709000 12068 raft_consensus.cc:482] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:41:11.709045 12068 raft_consensus.cc:3037] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:11.710135 12068 raft_consensus.cc:504] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:11.710498 12068 leader_election.cc:288] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [CANDIDATE]: Term 1 election: Requested vote from peers 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697), 61e0a4f0e52f4cfb849e20e48cd00682 (127.26.52.65:38627)
I20260807 22:41:11.710863 11713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3821c669ad6f48b8936352343ab8782d" candidate_uuid: "e12c363ffb734666a927a6e547561c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61e0a4f0e52f4cfb849e20e48cd00682"
I20260807 22:41:11.710896 11860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3821c669ad6f48b8936352343ab8782d" candidate_uuid: "e12c363ffb734666a927a6e547561c64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "028e8b3cd1b449dd83575f6e38859fef"
I20260807 22:41:11.710986 11713 raft_consensus.cc:3037] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:11.711058 11860 raft_consensus.cc:3037] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:11.712191 11713 raft_consensus.cc:2454] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12c363ffb734666a927a6e547561c64 in term 1.
I20260807 22:41:11.712234 11860 raft_consensus.cc:2454] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12c363ffb734666a927a6e547561c64 in term 1.
I20260807 22:41:11.712558 11930 leader_election.cc:302] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61e0a4f0e52f4cfb849e20e48cd00682, e12c363ffb734666a927a6e547561c64; no voters:
I20260807 22:41:11.712730 12068 raft_consensus.cc:2781] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:11.712998 12068 raft_consensus.cc:686] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 1 LEADER]: Becoming Leader. State: Replica: e12c363ffb734666a927a6e547561c64, State: Running, Role: LEADER
I20260807 22:41:11.713402 12068 consensus_queue.cc:237] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:11.716948 11561 catalog_manager.cc:5495] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12c363ffb734666a927a6e547561c64 (127.26.52.67). New cstate: current_term: 1 leader_uuid: "e12c363ffb734666a927a6e547561c64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } health_report { overall_health: UNKNOWN } } }
I20260807 22:41:11.770488 12062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.766904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54014 (local address 127.26.52.67:43259)
0807 22:41:11.767196 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.767202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.767223 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:41:11.767326 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.767328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.767386 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.767479 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:41:11.767707 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.768288 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.769073 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.769281 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.769364 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.769634 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:41:11.770068 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:41:11.770159 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:11.770241 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 22:41:11.770294 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260807 22:41:11.776672 11860 raft_consensus.cc:1261] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef [term 1 FOLLOWER]: Refusing update from remote peer e12c363ffb734666a927a6e547561c64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:11.776669 11713 raft_consensus.cc:1261] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Refusing update from remote peer e12c363ffb734666a927a6e547561c64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:11.777436 12068 consensus_queue.cc:1035] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:11.777658 12072 consensus_queue.cc:1035] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:11.794834 11562 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:11.795029 11562 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:11.797639 11562 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Sending DeleteTablet for 3 replicas of tablet 3821c669ad6f48b8936352343ab8782d
I20260807 22:41:11.798413 11840 tablet_service.cc:1514] Processing DeleteTablet for tablet 3821c669ad6f48b8936352343ab8782d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:11 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:51660
I20260807 22:41:11.798651 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 11601
I20260807 22:41:11.798647 11980 tablet_service.cc:1514] Processing DeleteTablet for tablet 3821c669ad6f48b8936352343ab8782d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:11 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:54008
I20260807 22:41:11.800843 12085 tablet_replica.cc:330] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: stopping tablet replica
I20260807 22:41:11.801493 12085 raft_consensus.cc:2229] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:11.802003 12085 raft_consensus.cc:2258] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:11.804366 12085 ts_tablet_manager.cc:1905] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:11.806010 12086 tablet_replica.cc:330] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: stopping tablet replica
I20260807 22:41:11.806456 12086 raft_consensus.cc:2229] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:41:11.806957 12086 raft_consensus.cc:2258] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:11.807693 12085 ts_tablet_manager.cc:1918] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:11.807807 12085 log.cc:1196] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/3821c669ad6f48b8936352343ab8782d
I20260807 22:41:11.808192 12085 ts_tablet_manager.cc:1939] T 3821c669ad6f48b8936352343ab8782d P 028e8b3cd1b449dd83575f6e38859fef: Deleting consensus metadata
I20260807 22:41:11.809037 12086 ts_tablet_manager.cc:1905] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:11.809780 11545 catalog_manager.cc:4841] TS 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697): tablet 3821c669ad6f48b8936352343ab8782d (table test-table [id=71eba6c202a24559aee09def511a9396]) successfully deleted
I20260807 22:41:11.811611 12086 ts_tablet_manager.cc:1918] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:11.811739 12086 log.cc:1196] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/3821c669ad6f48b8936352343ab8782d
W20260807 22:41:11.812156 11543 connection.cc:535] client connection to 127.26.52.65:38627 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 22:41:11.812364 11543 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 22:41:11.812394 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 11765
I20260807 22:41:11.813978 12086 ts_tablet_manager.cc:1939] T 3821c669ad6f48b8936352343ab8782d P e12c363ffb734666a927a6e547561c64: Deleting consensus metadata
I20260807 22:41:11.815418 11548 catalog_manager.cc:4841] TS e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259): tablet 3821c669ad6f48b8936352343ab8782d (table test-table [id=71eba6c202a24559aee09def511a9396]) successfully deleted
I20260807 22:41:11.816228 12088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.815753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:38627 (local address 127.0.0.1:51668)
0807 22:41:11.815998 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:11.816081 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:38627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":84,"threads_started":1}
W20260807 22:41:11.816458 11543 catalog_manager.cc:4584] TS 61e0a4f0e52f4cfb849e20e48cd00682 (127.26.52.65:38627): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3821c669ad6f48b8936352343ab8782d: Network error: Client connection negotiation failed: client connection to 127.26.52.65:38627: connect: Connection refused (error 111)
I20260807 22:41:11.822028 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 11913
I20260807 22:41:11.830830 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 11526
I20260807 22:41:31.840651 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37831
--webserver_interface=127.26.52.126
--webserver_port=36741
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:37831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:31.958148 12089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:31.958454 12089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:31.958498 12089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:31.962525 12089 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 22:41:31.962585 12089 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 22:41:31.962601 12089 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 22:41:31.962615 12089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:31.962634 12089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:31.962652 12089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:31.962675 12089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:31.962692 12089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:31.968103 12089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:37831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=36741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:31.969233 12089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:31.970263 12089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:31.979912 12095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:31.979918 12096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:31.979951 12098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:31.979969 12089 server_base.cc:1034] running on GCE node
I20260807 22:41:31.980834 12089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:31.982123 12089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:31.983318 12089 hybrid_clock.cc:648] HybridClock initialized: now 1786142491983307 us; error 31 us; skew 500 ppm
Aug 07 22:41:31 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142491, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:31.997107 12089 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:41:31.998317 12089 webserver.cc:460] Webserver started at http://127.26.52.126:36741/ using document root <none> and password file <none>
I20260807 22:41:31.998986 12089 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:31.999082 12089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:32.003971 12089 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:41:32.006337 12105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:32.007889 12089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:41:32.008024 12089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "83b6c12821374e1a9cdb40836091d100"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "6262b0a8b0c470a23713f91c66c327e1"
server_key_iv: "e53db029c1587d2ace67fd7efbde937e"
server_key_version: "encryptionkey@0"
I20260807 22:41:32.008693 12089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:32.036237 12089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:32.039348 12089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:32.039523 12089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:32.047289 12089 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:37831
I20260807 22:41:32.047595 12160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:37831 every 8 connection(s)
I20260807 22:41:32.048507 12089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:32.049141 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 12089
I20260807 22:41:32.049620 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:38627
--local_ip_for_outbound_sockets=127.26.52.65
--tserver_master_addrs=127.26.52.126:37831
--webserver_port=45737
--webserver_interface=127.26.52.65
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:41:32.053803 12162 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:41:32.056746 12162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Bootstrap starting.
I20260807 22:41:32.081666 12162 log.cc:824] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:32.097162 12162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:41:32.097710 12162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Bootstrap complete.
I20260807 22:41:32.103672 12162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:41:32.104353 12162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83b6c12821374e1a9cdb40836091d100, State: Initialized, Role: FOLLOWER
I20260807 22:41:32.104986 12162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:41:32.105170 12162 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:32.105261 12162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:32.105393 12162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:41:32.107630 12162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:41:32.108075 12162 leader_election.cc:302] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83b6c12821374e1a9cdb40836091d100; no voters:
I20260807 22:41:32.108543 12162 leader_election.cc:288] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 22:41:32.108635 12166 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 22:41:32.108860 12166 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [term 3 LEADER]: Becoming Leader. State: Replica: 83b6c12821374e1a9cdb40836091d100, State: Running, Role: LEADER
I20260807 22:41:32.109175 12166 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } }
I20260807 22:41:32.109946 12162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:32.110244 12168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83b6c12821374e1a9cdb40836091d100. Latest consensus state: current_term: 3 leader_uuid: "83b6c12821374e1a9cdb40836091d100" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } } }
I20260807 22:41:32.110389 12168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:32.110670 12167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "83b6c12821374e1a9cdb40836091d100" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83b6c12821374e1a9cdb40836091d100" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37831 } } }
I20260807 22:41:32.110770 12170 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:32.110785 12167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:32.116596 12170 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:32.117473 12170 catalog_manager.cc:1259] Loaded cluster ID: 2abbd27b4e9f4ab39240af6054a8d16a
I20260807 22:41:32.117540 12170 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:32.120112 12170 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:32.120934 12170 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Loaded TSK: 0
I20260807 22:41:32.121024 12170 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 83b6c12821374e1a9cdb40836091d100: Loaded TSK: 1
F20260807 22:41:32.122371 12170 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fdb5c2309ad google::LogMessage::Fail() at ??:0
@ 0x7fdb5c23388a google::LogMessage::SendToLog() at ??:0
@ 0x7fdb5c2304de google::LogMessage::Flush() at ??:0
@ 0x7fdb5c231a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fdb5eef418d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fdb5eeecf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fdb66b957bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fdb66b6f99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fdb66b70178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7fdb66bb1df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fdb66bd082b std::function<>::operator()() at ??:0
@ 0x7fdb66b6fb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fdb66b70f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fdb66b6d579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fdb66bb1640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fdb5e4823d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fdb5e482c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fdb5e4843f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fdb5e473512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fdb5fab76db start_thread at ??:0
@ 0x7fdb5ad2e61f clone at ??:0
W20260807 22:41:32.206738 12164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:32.207006 12164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:32.207053 12164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:32.211905 12164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:32.211964 12164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:32.212028 12164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:41:32.218446 12164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:38627
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=45737
--tserver_master_addrs=127.26.52.126:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:32.219558 12164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:32.220657 12164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:32.231357 12213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:32.231534 12212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:32.231869 12216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:32.232096 12164 server_base.cc:1034] running on GCE node
I20260807 22:41:32.232576 12164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:32.233292 12164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:32.234478 12164 hybrid_clock.cc:648] HybridClock initialized: now 1786142492234444 us; error 46 us; skew 500 ppm
Aug 07 22:41:32 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142492, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:32.237833 12164 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:41:32.238973 12164 webserver.cc:460] Webserver started at http://127.26.52.65:45737/ using document root <none> and password file <none>
I20260807 22:41:32.239637 12164 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:32.239753 12164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:32.244480 12164 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:41:32.247184 12226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:32.248781 12164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:41:32.248951 12164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "61e0a4f0e52f4cfb849e20e48cd00682"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "e53de9427f5f65ef0dddca154592d4b9"
server_key_iv: "20b0a2ed459615132efac2a3fb1d4fe7"
server_key_version: "encryptionkey@0"
I20260807 22:41:32.249575 12164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:32.265273 12164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:32.269229 12164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:32.269479 12164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:32.270251 12164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:32.271538 12234 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:41:32.276305 12164 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:41:32.276378 12164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260807 22:41:32.276463 12164 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:41:32.278339 12164 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:41:32.278406 12164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 22:41:32.278687 12234 tablet_bootstrap.cc:492] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Bootstrap starting.
I20260807 22:41:32.290650 12164 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:38627
I20260807 22:41:32.290867 12350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:38627 every 8 connection(s)
I20260807 22:41:32.292163 12164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:32.299293 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 12164
I20260807 22:41:32.299883 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:40697
--local_ip_for_outbound_sockets=127.26.52.66
--tserver_master_addrs=127.26.52.126:37831
--webserver_port=36559
--webserver_interface=127.26.52.66
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:41:32.301795 12234 log.cc:824] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:32.310451 12234 tablet_bootstrap.cc:492] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:41:32.311010 12234 tablet_bootstrap.cc:492] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Bootstrap complete.
I20260807 22:41:32.312816 12234 ts_tablet_manager.cc:1397] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Time spent bootstrapping tablet: real 0.034s user 0.023s sys 0.010s
I20260807 22:41:32.317740 12234 raft_consensus.cc:348] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:32.318560 12234 raft_consensus.cc:729] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61e0a4f0e52f4cfb849e20e48cd00682, State: Initialized, Role: FOLLOWER
I20260807 22:41:32.319289 12234 consensus_queue.cc:260] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:32.320714 12234 ts_tablet_manager.cc:1428] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682: Time spent starting tablet: real 0.008s user 0.007s sys 0.001s
W20260807 22:41:32.376379 12353 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:32.295146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:60565)
0807 22:41:32.296501 (+ 1355us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:32.296566 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:32.297677 (+ 1111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:32.375444 (+ 77767us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1082,"thread_start_us":199,"threads_started":1}
W20260807 22:41:32.377097 12351 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:37831 (0 consecutive failures): Network error: Failed to ping master at 127.26.52.126:37831: Client connection negotiation failed: client connection to 127.26.52.126:37831: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 22:41:32.377934 12353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:32.377646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:52901)
0807 22:41:32.377784 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:32.377864 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 22:41:32.378743 12353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:32.378468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:36871)
0807 22:41:32.378608 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:32.378669 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 22:41:32.378948 12351 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:41:32.432737 12354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:32.433076 12354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:32.433131 12354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:32.437233 12354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:32.437299 12354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:32.437361 12354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:41:32.442867 12354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:40697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=36559
--tserver_master_addrs=127.26.52.126:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:32.444099 12354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:32.445287 12354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:32.455586 12364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:32.455606 12361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:32.455646 12362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:32.456068 12354 server_base.cc:1034] running on GCE node
I20260807 22:41:32.456579 12354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:32.457297 12354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:32.458491 12354 hybrid_clock.cc:648] HybridClock initialized: now 1786142492458455 us; error 49 us; skew 500 ppm
Aug 07 22:41:32 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142492, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:32.461412 12354 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:41:32.462680 12354 webserver.cc:460] Webserver started at http://127.26.52.66:36559/ using document root <none> and password file <none>
I20260807 22:41:32.463261 12354 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:32.463320 12354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:32.467342 12354 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:41:32.469661 12372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:32.471009 12354 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:41:32.471119 12354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "028e8b3cd1b449dd83575f6e38859fef"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-8w9v"
server_key: "b70ec01fdb4d4279c30377cc5fee0c9f"
server_key_iv: "698eb63694276808b6ee410d5fd5c658"
server_key_version: "encryptionkey@0"
I20260807 22:41:32.471671 12354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:32.485203 12354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:32.488601 12354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:32.488780 12354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:32.489373 12354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:32.490275 12354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:32.490329 12354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:32.490373 12354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:32.490388 12354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:32.500447 12354 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:40697
I20260807 22:41:32.500519 12495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:40697 every 8 connection(s)
I20260807 22:41:32.501579 12354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:32.504432 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 12354
I20260807 22:41:32.504971 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:43259
--local_ip_for_outbound_sockets=127.26.52.67
--tserver_master_addrs=127.26.52.126:37831
--webserver_port=46817
--webserver_interface=127.26.52.67
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:45487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:41:32.506281 12498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:32.503816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:51525)
0807 22:41:32.504453 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:32.504611 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":128,"threads_started":1}
W20260807 22:41:32.506807 12496 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:37831 (0 consecutive failures): Network error: Failed to ping master at 127.26.52.126:37831: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
I20260807 22:41:32.507565 12498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:32.507309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:33585)
0807 22:41:32.507449 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:32.507502 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 22:41:32.508263 12498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:32.508020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:42537)
0807 22:41:32.508153 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:32.508201 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 22:41:32.508446 12496 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:41:32.623356 12499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:32.623696 12499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:32.623778 12499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:32.628376 12499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:32.628463 12499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:32.628552 12499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:41:32.634147 12499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:45487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:43259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=46817
--tserver_master_addrs=127.26.52.126:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:32.635351 12499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:32.636544 12499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:32.646790 12507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:32.646811 12505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:32.646793 12504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:32.647078 12499 server_base.cc:1034] running on GCE node
I20260807 22:41:32.647648 12499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:32.648437 12499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:32.649652 12499 hybrid_clock.cc:648] HybridClock initialized: now 1786142492649639 us; error 29 us; skew 500 ppm
Aug 07 22:41:32 dist-test-slave-8w9v krb5kdc[10929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142492, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:32.652552 12499 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:41:32.653609 12499 webserver.cc:460] Webserver started at http://127.26.52.67:46817/ using document root <none> and password file <none>
I20260807 22:41:32.654291 12499 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:32.654390 12499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:32.658553 12499 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 22:41:32.660821 12514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:32.662091 12499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:41:32.662271 12499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "e12c363ffb734666a927a6e547561c64"
format_stamp: "Formatted at 2026-08-07 22:40:50 on dist-test-slave-8w9v"
server_key: "1f3ed498d8585fd4b145a4706703a2dc"
server_key_iv: "65b0dc0ac252cbe98e2700cbae797d5d"
server_key_version: "encryptionkey@0"
I20260807 22:41:32.662848 12499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:32.680773 12499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:32.684064 12499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:32.684334 12499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:32.685009 12499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:32.685953 12499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:32.686040 12499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:32.686120 12499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:32.686164 12499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:32.696439 12499 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:43259
I20260807 22:41:32.696456 12634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:43259 every 8 connection(s)
I20260807 22:41:32.697585 12499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:32.701844 12637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:32.699856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:48803)
0807 22:41:32.700468 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:32.700592 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":126,"threads_started":1}
W20260807 22:41:32.702313 12635 heartbeater.cc:644] Failed to heartbeat to 127.26.52.126:37831 (0 consecutive failures): Network error: Failed to ping master at 127.26.52.126:37831: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
I20260807 22:41:32.703090 12637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:32.702811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:38927)
0807 22:41:32.702965 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:32.703022 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 22:41:32.703848 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 12499
I20260807 22:41:32.703938 12637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:32.703679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:39295)
0807 22:41:32.703800 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:32.703848 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 22:41:32.704097 12635 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 22:41:33.380208 12639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:33.379705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:38201)
0807 22:41:33.379988 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:33.380054 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":88,"threads_started":1}
I20260807 22:41:33.509778 12640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:33.509223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:38705)
0807 22:41:33.509587 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:33.509658 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":93,"threads_started":1}
I20260807 22:41:33.705291 12641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:33.704813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:53257)
0807 22:41:33.705113 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:33.705180 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":78,"threads_started":1}
I20260807 22:41:34.018317 12642 raft_consensus.cc:482] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:34.018571 12642 raft_consensus.cc:504] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:34.019866 12642 leader_election.cc:288] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697), e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259)
Aug 07 22:41:34 dist-test-slave-8w9v krb5kdc[10929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142492, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.66@KRBTEST.COM
Aug 07 22:41:34 dist-test-slave-8w9v krb5kdc[10929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142492, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.67@KRBTEST.COM
I20260807 22:41:34.034698 12646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:34.020555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:47037 (local address 127.26.52.66:40697)
0807 22:41:34.020929 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:34.020942 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:34.020981 (+ 39us) server_negotiation.cc:407] Connection header received
0807 22:41:34.021604 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:34.021609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:34.021940 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:34.022262 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:34.023630 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:34.024731 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:34.026158 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:34.026613 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:34.026795 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:34.029691 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:34.029696 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:34.029708 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:34.029738 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:34.031916 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:34.032541 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:34.032548 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:34.032553 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:34.032677 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:34.033052 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:34.033055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:34.033057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:34.033489 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:34.033656 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:34.034215 (+ 559us) server_negotiation.cc:299] Negotiation successful
0807 22:41:34.034505 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":142,"threads_started":1}
I20260807 22:41:34.034686 12643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:34.020056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:40697 (local address 127.26.52.65:47037)
0807 22:41:34.020393 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:34.020409 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:34.020523 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:34.022611 (+ 2088us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:34.022613 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:34.022941 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:34.023447 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:34.023463 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:34.024894 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:34.024897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:34.026011 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:34.026022 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:34.026749 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:34.026753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:34.026998 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:34.027763 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:34.027775 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:34.029451 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:34.032047 (+ 2596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:34.032054 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:34.032068 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:34.032412 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:34.032784 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:34.032788 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:34.032790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:34.032943 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:34.033628 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:34.033635 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:34.033873 (+ 238us) client_negotiation.cc:769] Sending connection context
0807 22:41:34.034085 (+ 212us) client_negotiation.cc:240] Negotiation successful
0807 22:41:34.034484 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":233,"spinlock_wait_cycles":10496,"thread_start_us":93,"threads_started":1}
I20260807 22:41:34.034763 12645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:34.020510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:42671 (local address 127.26.52.67:43259)
0807 22:41:34.020777 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:34.020811 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:34.020871 (+ 60us) server_negotiation.cc:407] Connection header received
0807 22:41:34.021576 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:34.021583 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:34.021939 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:34.022225 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:34.023656 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:34.024725 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:34.026145 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:34.026613 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:34.026795 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:34.029972 (+ 3177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:34.029976 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:34.029987 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:34.030017 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:34.032297 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:34.032805 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:34.032811 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:34.032816 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:34.032951 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:34.033287 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:34.033291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:34.033295 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:34.033684 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:34.033839 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:34.034240 (+ 401us) server_negotiation.cc:299] Negotiation successful
0807 22:41:34.034544 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":70,"threads_started":1}
I20260807 22:41:34.035641 12644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:34.020156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:43259 (local address 127.26.52.65:42671)
0807 22:41:34.020483 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:34.020498 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:34.020603 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:34.022378 (+ 1775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:34.022384 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:34.022952 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:34.023447 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:34.023462 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:34.024875 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:34.024879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:34.026009 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:34.026019 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:34.026745 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:34.026748 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:34.026999 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:34.027709 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:34.027726 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:34.029772 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:34.032429 (+ 2657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:34.032436 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:34.032438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:34.032658 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:34.033063 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:34.033068 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:34.033070 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:34.033163 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:34.033821 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:34.033824 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:34.033936 (+ 112us) client_negotiation.cc:769] Sending connection context
0807 22:41:34.034086 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 22:41:34.034578 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":393,"spinlock_wait_cycles":24448,"thread_start_us":83,"threads_started":1}
W20260807 22:41:34.037647 12228 leader_election.cc:341] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697): Not found: Tablet not found: 3821c669ad6f48b8936352343ab8782d
W20260807 22:41:34.037849 12230 leader_election.cc:341] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259): Not found: Tablet not found: 3821c669ad6f48b8936352343ab8782d
I20260807 22:41:34.037978 12230 leader_election.cc:302] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61e0a4f0e52f4cfb849e20e48cd00682; no voters: 028e8b3cd1b449dd83575f6e38859fef, e12c363ffb734666a927a6e547561c64
I20260807 22:41:34.038280 12642 raft_consensus.cc:2726] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:41:34.381460 12644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:34.381125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:60845)
0807 22:41:34.381296 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:34.381369 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 22:41:34.511405 12647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:34.510840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:56857)
0807 22:41:34.511160 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:34.511251 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":129,"threads_started":1}
I20260807 22:41:34.706648 12648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:34.706173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:45873)
0807 22:41:34.706480 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:34.706548 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":83,"threads_started":1}
I20260807 22:41:35.383087 12649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:35.382579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:59189)
0807 22:41:35.382901 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:35.382980 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":101,"threads_started":1}
I20260807 22:41:35.512873 12650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:35.512404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:48025)
0807 22:41:35.512704 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:35.512767 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":98,"threads_started":1}
I20260807 22:41:35.585584 12651 raft_consensus.cc:482] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:35.585769 12651 raft_consensus.cc:504] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:35.586265 12651 leader_election.cc:288] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697), e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259)
W20260807 22:41:35.587177 12228 leader_election.cc:341] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697): Not found: Tablet not found: 3821c669ad6f48b8936352343ab8782d
W20260807 22:41:35.587271 12230 leader_election.cc:341] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259): Not found: Tablet not found: 3821c669ad6f48b8936352343ab8782d
I20260807 22:41:35.587396 12230 leader_election.cc:302] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61e0a4f0e52f4cfb849e20e48cd00682; no voters: 028e8b3cd1b449dd83575f6e38859fef, e12c363ffb734666a927a6e547561c64
I20260807 22:41:35.587590 12651 raft_consensus.cc:2726] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:41:35.708230 12652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:35.707658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:42623)
0807 22:41:35.707980 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:35.708047 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":109,"threads_started":1}
I20260807 22:41:36.384615 12653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:36.384072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:46351)
0807 22:41:36.384439 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:36.384509 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":152,"threads_started":1}
I20260807 22:41:36.514225 12654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:36.513703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:60023)
0807 22:41:36.514032 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:36.514098 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":102,"threads_started":1}
I20260807 22:41:36.709690 12655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:36.709182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:37619)
0807 22:41:36.709481 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:36.709545 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":113,"threads_started":1}
I20260807 22:41:37.386091 12656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:37.385591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:41091)
0807 22:41:37.385897 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:37.385985 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":96,"threads_started":1}
I20260807 22:41:37.515679 12657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:37.515189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:56769)
0807 22:41:37.515510 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:37.515574 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":117,"threads_started":1}
I20260807 22:41:37.711153 12658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:37.710611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:36107)
0807 22:41:37.710960 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:37.711043 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":88,"threads_started":1}
I20260807 22:41:37.808350 12659 raft_consensus.cc:482] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:37.808543 12659 raft_consensus.cc:504] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:37.809065 12659 leader_election.cc:288] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697), e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259)
W20260807 22:41:37.809929 12228 leader_election.cc:341] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697): Not found: Tablet not found: 3821c669ad6f48b8936352343ab8782d
W20260807 22:41:37.810111 12230 leader_election.cc:341] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259): Not found: Tablet not found: 3821c669ad6f48b8936352343ab8782d
I20260807 22:41:37.810222 12230 leader_election.cc:302] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61e0a4f0e52f4cfb849e20e48cd00682; no voters: 028e8b3cd1b449dd83575f6e38859fef, e12c363ffb734666a927a6e547561c64
I20260807 22:41:37.810456 12659 raft_consensus.cc:2726] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:41:38.387451 12660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:38.386946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:42633)
0807 22:41:38.387257 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:38.387348 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":85,"threads_started":1}
I20260807 22:41:38.517171 12661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:38.516670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:54573)
0807 22:41:38.516996 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:38.517066 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":87,"threads_started":1}
I20260807 22:41:38.712710 12662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:38.712238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:40665)
0807 22:41:38.712542 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:38.712608 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":99,"threads_started":1}
I20260807 22:41:39.389025 12663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:39.388542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:51479)
0807 22:41:39.388850 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:39.388909 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":102,"threads_started":1}
I20260807 22:41:39.518647 12664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:39.518083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:44265)
0807 22:41:39.518468 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:39.518538 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":86,"threads_started":1}
I20260807 22:41:39.714104 12666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:39.713599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:33791)
0807 22:41:39.713942 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:39.714004 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":100,"threads_started":1}
I20260807 22:41:40.390362 12667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:40.389903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:53887)
0807 22:41:40.390196 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:40.390259 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":99,"threads_started":1}
I20260807 22:41:40.520187 12668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:40.519595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:36095)
0807 22:41:40.519913 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:40.520002 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":96,"threads_started":1}
I20260807 22:41:40.715546 12669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:40.715028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:53707)
0807 22:41:40.715377 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:40.715445 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":107,"threads_started":1}
I20260807 22:41:41.111049 12670 raft_consensus.cc:482] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:41.111241 12670 raft_consensus.cc:504] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:41.111686 12670 leader_election.cc:288] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697), e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259)
W20260807 22:41:41.112610 12228 leader_election.cc:341] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697): Not found: Tablet not found: 3821c669ad6f48b8936352343ab8782d
W20260807 22:41:41.112720 12230 leader_election.cc:341] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259): Not found: Tablet not found: 3821c669ad6f48b8936352343ab8782d
I20260807 22:41:41.112784 12230 leader_election.cc:302] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61e0a4f0e52f4cfb849e20e48cd00682; no voters: 028e8b3cd1b449dd83575f6e38859fef, e12c363ffb734666a927a6e547561c64
I20260807 22:41:41.112931 12670 raft_consensus.cc:2726] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:41:41.391782 12671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:41.391295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:56175)
0807 22:41:41.391610 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:41.391677 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":88,"threads_started":1}
I20260807 22:41:41.521553 12672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:41.521031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:42861)
0807 22:41:41.521373 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:41.521442 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":84,"threads_started":1}
I20260807 22:41:41.716804 12674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:41.716382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:40229)
0807 22:41:41.716651 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:41.716707 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":75,"threads_started":1}
I20260807 22:41:42.393333 12675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:42.392844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:40681)
0807 22:41:42.393157 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:42.393222 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":90,"threads_started":1}
I20260807 22:41:42.523057 12676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:42.522571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:37927)
0807 22:41:42.522869 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:42.522952 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":87,"threads_started":1}
I20260807 22:41:42.718192 12677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:42.717694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:60099)
0807 22:41:42.718026 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:42.718092 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":82,"threads_started":1}
I20260807 22:41:43.394685 12678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:43.394205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:40135)
0807 22:41:43.394518 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:43.394583 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":89,"threads_started":1}
I20260807 22:41:43.524477 12679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:43.524013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:40757)
0807 22:41:43.524314 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:43.524370 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":113,"threads_started":1}
I20260807 22:41:43.719628 12680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:43.719120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:53089)
0807 22:41:43.719456 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:43.719523 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":101,"threads_started":1}
I20260807 22:41:43.851225 12681 raft_consensus.cc:482] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:43.851436 12681 raft_consensus.cc:504] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "028e8b3cd1b449dd83575f6e38859fef" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 40697 } } peers { permanent_uuid: "e12c363ffb734666a927a6e547561c64" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 43259 } } peers { permanent_uuid: "61e0a4f0e52f4cfb849e20e48cd00682" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 38627 } }
I20260807 22:41:43.851881 12681 leader_election.cc:288] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697), e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259)
W20260807 22:41:43.852758 12228 leader_election.cc:341] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 028e8b3cd1b449dd83575f6e38859fef (127.26.52.66:40697): Not found: Tablet not found: 3821c669ad6f48b8936352343ab8782d
W20260807 22:41:43.852851 12230 leader_election.cc:341] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e12c363ffb734666a927a6e547561c64 (127.26.52.67:43259): Not found: Tablet not found: 3821c669ad6f48b8936352343ab8782d
I20260807 22:41:43.852969 12230 leader_election.cc:302] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61e0a4f0e52f4cfb849e20e48cd00682; no voters: 028e8b3cd1b449dd83575f6e38859fef, e12c363ffb734666a927a6e547561c64
I20260807 22:41:43.853145 12681 raft_consensus.cc:2726] T 3821c669ad6f48b8936352343ab8782d P 61e0a4f0e52f4cfb849e20e48cd00682 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:41:44.396241 12683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:44.395669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:38591)
0807 22:41:44.395999 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:44.396068 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":83,"threads_started":1}
I20260807 22:41:44.525985 12684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:44.525482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:33899)
0807 22:41:44.525791 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:44.525858 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":89,"threads_started":1}
I20260807 22:41:44.721405 12685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:44.720633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:49899)
0807 22:41:44.721089 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:44.721272 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":224,"threads_started":1}
I20260807 22:41:45.397666 12686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:45.397128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:38527)
0807 22:41:45.397495 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:45.397564 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":124,"threads_started":1}
I20260807 22:41:45.527359 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:45.526901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:54373)
0807 22:41:45.527183 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:45.527253 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":84,"threads_started":1}
I20260807 22:41:45.722776 12688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:45.722335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:45599)
0807 22:41:45.722620 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:45.722678 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":106,"threads_started":1}
I20260807 22:41:46.398933 12689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:46.398483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:41127)
0807 22:41:46.398765 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:46.398827 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":80,"threads_started":1}
I20260807 22:41:46.528728 12690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:46.528308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:34917)
0807 22:41:46.528573 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:46.528628 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":86,"threads_started":1}
I20260807 22:41:46.724296 12691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:46.723776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:58653)
0807 22:41:46.724067 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:46.724192 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":82,"threads_started":1}
I20260807 22:41:47.400681 12692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:47.400220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.65:53409)
0807 22:41:47.400516 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:47.400578 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":90,"threads_started":1}
I20260807 22:41:47.530112 12693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:47.529664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.66:38763)
0807 22:41:47.529948 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:47.530007 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":81,"threads_started":1}
I20260807 22:41:47.712008 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 12164
I20260807 22:41:47.723301 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 12354
I20260807 22:41:47.726224 12694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:47.725808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37831 (local address 127.26.52.67:37471)
0807 22:41:47.726078 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:47.726130 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.126:37831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":85,"threads_started":1}
I20260807 22:41:47.730485 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 12499
2026-08-07T22:41:47Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59869 ms)
[----------] 30 tests from SecurityITest (249065 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:41:47 dist-test-slave-8w9v krb5kdc[12697](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:41:47 dist-test-slave-8w9v krb5kdc[12697](info): set up 2 sockets
Aug 07 22:41:47 dist-test-slave-8w9v krb5kdc[12697](info): commencing operation
krb5kdc: starting...
W20260807 22:41:48.815645 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:41:48 dist-test-slave-8w9v krb5kdc[12697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:41:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:41:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:41:48.951419 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:38891
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:38891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:49.067149 12710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:49.067492 12710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:49.067569 12710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:49.071586 12710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:49.071692 12710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:49.071729 12710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:49.071768 12710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:49.071798 12710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:49.077275 12710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:38891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:38891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:49.078477 12710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:49.079559 12710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:49.088836 12717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:49.088865 12719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:49.088868 12716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:49.088945 12710 server_base.cc:1034] running on GCE node
I20260807 22:41:49.089748 12710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:49.090934 12710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:49.092162 12710 hybrid_clock.cc:648] HybridClock initialized: now 1786142509092111 us; error 27 us; skew 500 ppm
Aug 07 22:41:49 dist-test-slave-8w9v krb5kdc[12697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:49.099936 12710 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:41:49.101012 12710 webserver.cc:460] Webserver started at http://127.26.52.126:43667/ using document root <none> and password file <none>
I20260807 22:41:49.101577 12710 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:49.101636 12710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:49.101807 12710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:49.103871 12710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "a7743cd401f543f6a89a93d7e8ac3d00"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "523d40c0786db6b274accaec94b8fbef"
server_key_iv: "d1bbf5a67816248a9b2719d1daba98ae"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.104476 12710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "a7743cd401f543f6a89a93d7e8ac3d00"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "523d40c0786db6b274accaec94b8fbef"
server_key_iv: "d1bbf5a67816248a9b2719d1daba98ae"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.108295 12710 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:41:49.110795 12726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:49.112083 12710 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:41:49.112280 12710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "a7743cd401f543f6a89a93d7e8ac3d00"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "523d40c0786db6b274accaec94b8fbef"
server_key_iv: "d1bbf5a67816248a9b2719d1daba98ae"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.112413 12710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:49.131654 12710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:49.135162 12710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:49.135382 12710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:49.143061 12710 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:38891
I20260807 22:41:49.143088 12782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:38891 every 8 connection(s)
I20260807 22:41:49.144064 12710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:49.146948 12783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:49.149036 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 12710
I20260807 22:41:49.149147 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:41:49.149470 26833 external_mini_cluster.cc:1428] Setting key 78176aea52479c985e86e0c6be92d1c5
I20260807 22:41:49.154429 12783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00: Bootstrap starting.
I20260807 22:41:49.157370 12783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:49.158306 12783 log.cc:824] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:41:49 dist-test-slave-8w9v krb5kdc[12697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:49.160876 12783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00: No bootstrap required, opened a new log
I20260807 22:41:49.164929 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.150991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36758 (local address 127.26.52.126:38891)
0807 22:41:49.151446 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:49.151467 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:49.151512 (+ 45us) server_negotiation.cc:407] Connection header received
0807 22:41:49.152425 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:49.152453 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:49.152887 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:49.153266 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:49.154016 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.155487 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.156464 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.157133 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.157327 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.160214 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:49.160219 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:49.160233 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:49.160260 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:49.162007 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:49.162520 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:49.162525 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:49.162530 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:49.162637 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:49.162928 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:49.162930 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:49.162931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:49.163314 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:49.163464 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:49.163803 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 22:41:49.164109 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":113,"threads_started":1}
I20260807 22:41:49.165375 12783 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7743cd401f543f6a89a93d7e8ac3d00" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38891 } }
I20260807 22:41:49.165648 12783 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:49.165745 12783 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7743cd401f543f6a89a93d7e8ac3d00, State: Initialized, Role: FOLLOWER
I20260807 22:41:49.166189 12783 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7743cd401f543f6a89a93d7e8ac3d00" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38891 } }
I20260807 22:41:49.166347 12783 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:49.166443 12783 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:49.166545 12783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:49.167662 12783 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7743cd401f543f6a89a93d7e8ac3d00" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38891 } }
I20260807 22:41:49.168018 12783 leader_election.cc:302] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7743cd401f543f6a89a93d7e8ac3d00; no voters:
I20260807 22:41:49.168380 12783 leader_election.cc:288] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:41:49.168655 12788 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:49.168880 12788 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [term 1 LEADER]: Becoming Leader. State: Replica: a7743cd401f543f6a89a93d7e8ac3d00, State: Running, Role: LEADER
I20260807 22:41:49.169270 12788 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7743cd401f543f6a89a93d7e8ac3d00" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38891 } }
I20260807 22:41:49.169898 12783 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:49.171020 12790 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7743cd401f543f6a89a93d7e8ac3d00. Latest consensus state: current_term: 1 leader_uuid: "a7743cd401f543f6a89a93d7e8ac3d00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7743cd401f543f6a89a93d7e8ac3d00" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38891 } } }
I20260807 22:41:49.171175 12790 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:49.171586 12797 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:49.171674 12789 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7743cd401f543f6a89a93d7e8ac3d00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7743cd401f543f6a89a93d7e8ac3d00" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38891 } } }
I20260807 22:41:49.171871 12789 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:49.174997 12797 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:49.181277 12797 catalog_manager.cc:1347] Generated new cluster ID: b8d7ca1e9bb44d9c8fb7e6f33059fc0b
I20260807 22:41:49.181391 12797 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:49.209939 12797 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:41:49.211288 12797 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:49.221889 12797 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00: Generated new TSK 0
I20260807 22:41:49.222805 12797 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:41:49.259173 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38891
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:49.375160 12809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:49.375491 12809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:49.375571 12809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:49.379585 12809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:49.379640 12809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:49.379698 12809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:41:49.384891 12809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:49.385993 12809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:49.387075 12809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:49.396700 12815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:49.396847 12809 server_base.cc:1034] running on GCE node
W20260807 22:41:49.396682 12816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:49.397053 12818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:49.397522 12809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:49.398137 12809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:49.399298 12809 hybrid_clock.cc:648] HybridClock initialized: now 1786142509399262 us; error 51 us; skew 500 ppm
Aug 07 22:41:49 dist-test-slave-8w9v krb5kdc[12697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:49.402124 12809 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:41:49.403074 12809 webserver.cc:460] Webserver started at http://127.26.52.65:33003/ using document root <none> and password file <none>
I20260807 22:41:49.403674 12809 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:49.403736 12809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:49.403990 12809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:49.406199 12809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "f1004f327bce4355bfca99da1b9bebeb"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "24f95688ffbd27ea89bf3141c83bf251"
server_key_iv: "603477d53d638beb0b5caca0405e3147"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.406777 12809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "f1004f327bce4355bfca99da1b9bebeb"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "24f95688ffbd27ea89bf3141c83bf251"
server_key_iv: "603477d53d638beb0b5caca0405e3147"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.410691 12809 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 22:41:49.413349 12826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:49.414613 12809 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:41:49.414762 12809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "f1004f327bce4355bfca99da1b9bebeb"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "24f95688ffbd27ea89bf3141c83bf251"
server_key_iv: "603477d53d638beb0b5caca0405e3147"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.414884 12809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:49.433156 12809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:49.436235 12809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:49.436447 12809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:49.437080 12809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:49.437959 12809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:49.438031 12809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:49.438105 12809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:49.438158 12809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:49.447093 12809 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:35243
I20260807 22:41:49.447116 12944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:35243 every 8 connection(s)
I20260807 22:41:49.448021 12809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:49.457002 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 12809
I20260807 22:41:49.457145 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
Aug 07 22:41:49 dist-test-slave-8w9v krb5kdc[12697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:49.457517 26833 external_mini_cluster.cc:1428] Setting key 0ed37ca2d5970dc0a3951b6be211d87b
I20260807 22:41:49.462487 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.449967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:46567 (local address 127.26.52.126:38891)
0807 22:41:49.450144 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:49.450149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:49.450954 (+ 805us) server_negotiation.cc:407] Connection header received
0807 22:41:49.452277 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:49.452280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:49.452328 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:49.452404 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:49.453529 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.454061 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.455183 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.455405 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.455485 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.458263 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:49.458266 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:49.458268 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:49.458315 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:49.459841 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:49.460513 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:49.460516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:49.460517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:49.460594 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:49.461009 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:49.461012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:49.461013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:49.461272 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:49.461481 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:49.462104 (+ 623us) server_negotiation.cc:299] Negotiation successful
0807 22:41:49.462248 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 22:41:49.463227 12947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.450362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:38891 (local address 127.26.52.65:46567)
0807 22:41:49.450801 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:49.450844 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:49.452021 (+ 1177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:49.452566 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:49.452572 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:49.452916 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:49.453392 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.453404 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.454170 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.454173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.455057 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.455071 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.455541 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.455543 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.455683 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.456315 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:49.456331 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:49.458053 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:49.459974 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:49.459983 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:49.460003 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:49.460415 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:49.460688 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:49.460694 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:49.460699 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:49.460898 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:49.461485 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:49.461493 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:49.461835 (+ 342us) client_negotiation.cc:769] Sending connection context
0807 22:41:49.462003 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 22:41:49.462268 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":109,"threads_started":1}
I20260807 22:41:49.464577 12945 heartbeater.cc:347] Connected to a master server at 127.26.52.126:38891
I20260807 22:41:49.464855 12945 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:49.465529 12945 heartbeater.cc:511] Master 127.26.52.126:38891 requested a full tablet report, sending...
I20260807 22:41:49.467201 12744 ts_manager.cc:194] Registered new tserver with Master: f1004f327bce4355bfca99da1b9bebeb (127.26.52.65:35243)
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:41:49.468494 12744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:46567
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:41:49.487908 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38891
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:49.601302 12950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:49.601552 12950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:49.601594 12950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:49.605487 12950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:49.605543 12950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:49.605600 12950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:41:49.610747 12950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:49.611804 12950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:49.612845 12950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:49.622987 12958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:49.623011 12956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:49.622994 12955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:49.623152 12950 server_base.cc:1034] running on GCE node
I20260807 22:41:49.623780 12950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:49.624542 12950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:49.625739 12950 hybrid_clock.cc:648] HybridClock initialized: now 1786142509625724 us; error 30 us; skew 500 ppm
Aug 07 22:41:49 dist-test-slave-8w9v krb5kdc[12697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:49.628747 12950 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:41:49.629801 12950 webserver.cc:460] Webserver started at http://127.26.52.66:36059/ using document root <none> and password file <none>
I20260807 22:41:49.630425 12950 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:49.630527 12950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:49.630795 12950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:49.633074 12950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "e018f637d8064a38b066312ea1ba432f"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "dcc7549f123d5079b851355ca13bccdf"
server_key_iv: "6cb38909bd96f3ffe348f33f99f4da21"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.633719 12950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "e018f637d8064a38b066312ea1ba432f"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "dcc7549f123d5079b851355ca13bccdf"
server_key_iv: "6cb38909bd96f3ffe348f33f99f4da21"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.637816 12950 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:41:49.640393 12966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:49.641609 12950 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:41:49.641757 12950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "e018f637d8064a38b066312ea1ba432f"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "dcc7549f123d5079b851355ca13bccdf"
server_key_iv: "6cb38909bd96f3ffe348f33f99f4da21"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.641877 12950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:49.662231 12950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:49.665498 12950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:49.665721 12950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:49.666366 12950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:49.667253 12950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:49.667327 12950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:49.667403 12950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:49.667448 12950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:49.676873 12950 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:44975
I20260807 22:41:49.676937 13089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:44975 every 8 connection(s)
I20260807 22:41:49.677837 12950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:49.685470 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 12950
I20260807 22:41:49.685628 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:41:49.686013 26833 external_mini_cluster.cc:1428] Setting key f6ed7eb538177a53927b1f768b11e6f5
Aug 07 22:41:49 dist-test-slave-8w9v krb5kdc[12697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:49.693044 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.679711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:33503 (local address 127.26.52.126:38891)
0807 22:41:49.679865 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:49.679870 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:49.680833 (+ 963us) server_negotiation.cc:407] Connection header received
0807 22:41:49.682138 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:49.682141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:49.682191 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:49.682273 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:49.683484 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.684012 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.685413 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.685738 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.685841 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.688953 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:49.688956 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:49.688958 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:49.688982 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:49.690688 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:49.691225 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:49.691232 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:49.691237 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:49.691334 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:49.691671 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:49.691677 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:49.691682 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:49.691958 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:49.692065 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:49.692660 (+ 595us) server_negotiation.cc:299] Negotiation successful
0807 22:41:49.692814 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:41:49.693794 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.680213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:38891 (local address 127.26.52.66:33503)
0807 22:41:49.680677 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:49.680721 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:49.681898 (+ 1177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:49.682441 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:49.682448 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:49.682806 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:49.683323 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.683338 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.684226 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.684229 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.685260 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.685275 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.685923 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.685928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.686138 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.686897 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:49.686918 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:49.688752 (+ 1834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:49.690817 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:49.690823 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:49.690836 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:49.691105 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:49.691430 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:49.691432 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:49.691434 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:49.691565 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:49.692061 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:49.692066 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:49.692376 (+ 310us) client_negotiation.cc:769] Sending connection context
0807 22:41:49.692546 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 22:41:49.692811 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":124,"threads_started":1}
I20260807 22:41:49.695060 13090 heartbeater.cc:347] Connected to a master server at 127.26.52.126:38891
I20260807 22:41:49.695298 13090 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:49.695802 13090 heartbeater.cc:511] Master 127.26.52.126:38891 requested a full tablet report, sending...
I20260807 22:41:49.696993 12744 ts_manager.cc:194] Registered new tserver with Master: e018f637d8064a38b066312ea1ba432f (127.26.52.66:44975)
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:41:49.697597 12744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:33503
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:41:49.716080 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38891
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:49.834088 13096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:49.834364 13096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:49.834443 13096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:49.838655 13096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:49.838725 13096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:49.838820 13096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:41:49.844350 13096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:38891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:49.845566 13096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:49.846693 13096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:49.856843 13102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:49.856904 13101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:49.857034 13096 server_base.cc:1034] running on GCE node
W20260807 22:41:49.856936 13104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:49.857568 13096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:49.858217 13096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:49.859385 13096 hybrid_clock.cc:648] HybridClock initialized: now 1786142509859368 us; error 32 us; skew 500 ppm
Aug 07 22:41:49 dist-test-slave-8w9v krb5kdc[12697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:49.862178 13096 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:41:49.863134 13096 webserver.cc:460] Webserver started at http://127.26.52.67:38275/ using document root <none> and password file <none>
I20260807 22:41:49.863726 13096 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:49.863817 13096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:49.864063 13096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:49.866142 13096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "dcafd35e37124c99a718c27455711822"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "32504b2f20eba03c015408aaf54ec810"
server_key_iv: "338934d26640d1c578988aa607038a41"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.866712 13096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "dcafd35e37124c99a718c27455711822"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "32504b2f20eba03c015408aaf54ec810"
server_key_iv: "338934d26640d1c578988aa607038a41"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.870581 13096 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:41:49.873148 13112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:49.874320 13096 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:41:49.874473 13096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "dcafd35e37124c99a718c27455711822"
format_stamp: "Formatted at 2026-08-07 22:41:49 on dist-test-slave-8w9v"
server_key: "32504b2f20eba03c015408aaf54ec810"
server_key_iv: "338934d26640d1c578988aa607038a41"
server_key_version: "encryptionkey@0"
I20260807 22:41:49.874593 13096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:49.892658 13096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:49.895659 13096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:49.895872 13096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:49.896587 13096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:49.897461 13096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:49.897531 13096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:49.897604 13096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:49.897656 13096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:49.907088 13096 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:40679
I20260807 22:41:49.907109 13235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:40679 every 8 connection(s)
I20260807 22:41:49.908051 13096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:49.913822 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 13096
I20260807 22:41:49.913972 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:41:49.914284 26833 external_mini_cluster.cc:1428] Setting key 187a61050ac18a162b7e2280df64e23a
Aug 07 22:41:49 dist-test-slave-8w9v krb5kdc[12697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:49.922585 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.910069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:43941 (local address 127.26.52.126:38891)
0807 22:41:49.910255 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:49.910261 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:49.911068 (+ 807us) server_negotiation.cc:407] Connection header received
0807 22:41:49.912400 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:49.912403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:49.912468 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:49.912543 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:49.913703 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.914374 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.915930 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.916269 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.916386 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.919062 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:49.919065 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:49.919067 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:49.919094 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:49.920572 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:49.921047 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:49.921050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:49.921051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:49.921136 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:49.921480 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:49.921483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:49.921484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:49.921675 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:49.921764 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:49.922356 (+ 592us) server_negotiation.cc:299] Negotiation successful
0807 22:41:49.922461 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 22:41:49.923496 13238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.910457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:38891 (local address 127.26.52.67:43941)
0807 22:41:49.910909 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:49.910951 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:49.912184 (+ 1233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:49.912703 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:49.912709 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:49.913054 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:49.913550 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.913563 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.914505 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.914509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.915808 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.915819 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.916533 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.916538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.916714 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.917358 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:49.917375 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:49.918899 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:49.920677 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:49.920682 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:49.920693 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:49.920952 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:49.921220 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:49.921222 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:49.921223 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:49.921358 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:49.921809 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:49.921815 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:49.922097 (+ 282us) client_negotiation.cc:769] Sending connection context
0807 22:41:49.922312 (+ 215us) client_negotiation.cc:240] Negotiation successful
0807 22:41:49.922602 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":121,"threads_started":1}
I20260807 22:41:49.924726 13236 heartbeater.cc:347] Connected to a master server at 127.26.52.126:38891
I20260807 22:41:49.924959 13236 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:49.925482 13236 heartbeater.cc:511] Master 127.26.52.126:38891 requested a full tablet report, sending...
I20260807 22:41:49.926512 12744 ts_manager.cc:194] Registered new tserver with Master: dcafd35e37124c99a718c27455711822 (127.26.52.67:40679)
I20260807 22:41:49.927171 12744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:43941
I20260807 22:41:49.928613 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:41:49.937932 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.930797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36774 (local address 127.26.52.126:38891)
0807 22:41:49.930914 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:49.930919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:49.931096 (+ 177us) server_negotiation.cc:407] Connection header received
0807 22:41:49.931200 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:49.931202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:49.931241 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:49.931308 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:49.932023 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.932602 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.933400 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.933603 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.933675 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.935083 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:49.935085 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:49.935087 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:49.935105 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:49.936440 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:49.936828 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:49.936831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:49.936832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:49.936904 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:49.937139 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:49.937141 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:49.937142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:49.937350 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:49.937454 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:49.937701 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 22:41:49.937796 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:41:49.941210 12744 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36774:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:41:49.944372 12744 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:41:49.959518 13248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.953543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:35243 (local address 127.0.0.1:44214)
0807 22:41:49.954745 (+ 1202us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:49.954759 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:49.954863 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:49.955495 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:49.955501 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:49.955523 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:49.955671 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.955680 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.956883 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.956887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.958112 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.958122 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.958950 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.958953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.959071 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.959110 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 22:41:49.959229 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 22:41:49.959358 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1137,"thread_start_us":98,"threads_started":1}
I20260807 22:41:49.959532 13251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.954345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44214 (local address 127.26.52.65:35243)
0807 22:41:49.954971 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:49.954986 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:49.955011 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:41:49.955091 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:49.955097 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:49.955312 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:49.955503 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:49.955801 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.956747 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.958244 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.958817 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.958955 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.959122 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:49.959259 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 22:41:49.959360 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":106,"threads_started":1}
I20260807 22:41:49.959830 13247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.953499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:44975 (local address 127.0.0.1:32878)
0807 22:41:49.954504 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:49.954556 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:49.954685 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:49.955520 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:49.955523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:49.955541 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:49.955735 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.955744 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.957436 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.957439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.958294 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.958305 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.959384 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.959387 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.959489 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.959515 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:41:49.959562 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 22:41:49.959652 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":808,"mutex_wait_us":19,"thread_start_us":92,"threads_started":1}
I20260807 22:41:49.960460 13249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.953669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32878 (local address 127.26.52.66:44975)
0807 22:41:49.955110 (+ 1441us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:49.955125 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:49.955143 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:41:49.955208 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:49.955212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:49.955355 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:49.955878 (+ 523us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:49.956063 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.957265 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.958442 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.959244 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.959923 (+ 679us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.960112 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:49.960203 (+ 91us) server_negotiation.cc:299] Negotiation successful
0807 22:41:49.960311 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1341,"thread_start_us":159,"threads_started":1}
I20260807 22:41:49.961164 13250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.953858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:40679 (local address 127.0.0.1:45180)
0807 22:41:49.954935 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:49.954948 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:49.955065 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:49.955816 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:49.955819 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:49.955838 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:49.955928 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.955935 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.957433 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.957437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.959536 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:49.959547 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.960771 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.960775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:49.960862 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.960885 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:41:49.960971 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:41:49.961039 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1013,"mutex_wait_us":26,"thread_start_us":122,"threads_started":1}
I20260807 22:41:49.961606 13252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:49.954289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45180 (local address 127.26.52.67:40679)
0807 22:41:49.954763 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:49.954777 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:49.955052 (+ 275us) server_negotiation.cc:407] Connection header received
0807 22:41:49.955182 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:49.955187 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:49.955329 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:49.955494 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:49.956065 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.957265 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.959782 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:49.960641 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:49.960753 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:49.960888 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:49.961341 (+ 453us) server_negotiation.cc:299] Negotiation successful
0807 22:41:49.961452 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":164,"threads_started":1}
I20260807 22:41:49.963340 12877 tablet_service.cc:1467] Processing CreateTablet for tablet c1436ca3bc3449d7af8cc59adc98c705 (DEFAULT_TABLE table=test-table [id=ad6393c4a9644d9f9bd31df6ce89a84f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:49.963342 13016 tablet_service.cc:1467] Processing CreateTablet for tablet c1436ca3bc3449d7af8cc59adc98c705 (DEFAULT_TABLE table=test-table [id=ad6393c4a9644d9f9bd31df6ce89a84f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:49.964223 13165 tablet_service.cc:1467] Processing CreateTablet for tablet c1436ca3bc3449d7af8cc59adc98c705 (DEFAULT_TABLE table=test-table [id=ad6393c4a9644d9f9bd31df6ce89a84f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:49.964577 12877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1436ca3bc3449d7af8cc59adc98c705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:49.964577 13016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1436ca3bc3449d7af8cc59adc98c705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:49.965015 13165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1436ca3bc3449d7af8cc59adc98c705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:49.971551 13253 tablet_bootstrap.cc:492] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: Bootstrap starting.
I20260807 22:41:49.972316 13254 tablet_bootstrap.cc:492] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb: Bootstrap starting.
I20260807 22:41:49.972736 13255 tablet_bootstrap.cc:492] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: Bootstrap starting.
I20260807 22:41:49.974736 13254 tablet_bootstrap.cc:654] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:49.974846 13253 tablet_bootstrap.cc:654] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:49.975335 13255 tablet_bootstrap.cc:654] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:49.975648 13254 log.cc:824] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:49.976203 13253 log.cc:824] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:49.976203 13255 log.cc:824] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:49.978144 13254 tablet_bootstrap.cc:492] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb: No bootstrap required, opened a new log
I20260807 22:41:49.978315 13253 tablet_bootstrap.cc:492] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: No bootstrap required, opened a new log
I20260807 22:41:49.978340 13255 tablet_bootstrap.cc:492] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: No bootstrap required, opened a new log
I20260807 22:41:49.978423 13254 ts_tablet_manager.cc:1397] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260807 22:41:49.978528 13255 ts_tablet_manager.cc:1397] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:41:49.978528 13253 ts_tablet_manager.cc:1397] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 22:41:49.982152 13254 raft_consensus.cc:348] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 } } peers { permanent_uuid: "f1004f327bce4355bfca99da1b9bebeb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 35243 } } peers { permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 } }
I20260807 22:41:49.982438 13254 raft_consensus.cc:374] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:49.982515 13254 raft_consensus.cc:729] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1004f327bce4355bfca99da1b9bebeb, State: Initialized, Role: FOLLOWER
I20260807 22:41:49.982539 13255 raft_consensus.cc:348] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 } } peers { permanent_uuid: "f1004f327bce4355bfca99da1b9bebeb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 35243 } } peers { permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 } }
I20260807 22:41:49.982859 13255 raft_consensus.cc:374] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:49.982540 13253 raft_consensus.cc:348] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 } } peers { permanent_uuid: "f1004f327bce4355bfca99da1b9bebeb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 35243 } } peers { permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 } }
I20260807 22:41:49.983160 13253 raft_consensus.cc:374] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:49.983083 13254 consensus_queue.cc:260] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 } } peers { permanent_uuid: "f1004f327bce4355bfca99da1b9bebeb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 35243 } } peers { permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 } }
I20260807 22:41:49.982934 13255 raft_consensus.cc:729] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e018f637d8064a38b066312ea1ba432f, State: Initialized, Role: FOLLOWER
I20260807 22:41:49.983321 13253 raft_consensus.cc:729] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcafd35e37124c99a718c27455711822, State: Initialized, Role: FOLLOWER
I20260807 22:41:49.983686 13255 consensus_queue.cc:260] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 } } peers { permanent_uuid: "f1004f327bce4355bfca99da1b9bebeb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 35243 } } peers { permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 } }
I20260807 22:41:49.983773 13253 consensus_queue.cc:260] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 } } peers { permanent_uuid: "f1004f327bce4355bfca99da1b9bebeb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 35243 } } peers { permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 } }
I20260807 22:41:49.984344 13254 ts_tablet_manager.cc:1428] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260807 22:41:49.984589 13090 heartbeater.cc:503] Master 127.26.52.126:38891 was elected leader, sending a full tablet report...
I20260807 22:41:49.984683 12945 heartbeater.cc:503] Master 127.26.52.126:38891 was elected leader, sending a full tablet report...
I20260807 22:41:49.984791 13255 ts_tablet_manager.cc:1428] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:41:49.984807 13253 ts_tablet_manager.cc:1428] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:41:49.985276 13236 heartbeater.cc:503] Master 127.26.52.126:38891 was elected leader, sending a full tablet report...
I20260807 22:41:50.004374 13259 raft_consensus.cc:482] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:50.004581 13259 raft_consensus.cc:504] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 } } peers { permanent_uuid: "f1004f327bce4355bfca99da1b9bebeb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 35243 } } peers { permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 } }
I20260807 22:41:50.005712 13259 leader_election.cc:288] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e018f637d8064a38b066312ea1ba432f (127.26.52.66:44975), dcafd35e37124c99a718c27455711822 (127.26.52.67:40679)
I20260807 22:41:50.009999 13249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.006023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:50237 (local address 127.26.52.66:44975)
0807 22:41:50.006177 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:50.006182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:50.006451 (+ 269us) server_negotiation.cc:407] Connection header received
0807 22:41:50.006611 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:50.006620 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:50.006667 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:50.006756 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:50.007051 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.007571 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.008827 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.009251 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.009537 (+ 286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.009600 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:50.009797 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 22:41:50.009872 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:41:50.010031 13263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.005944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:44975 (local address 127.26.52.65:50237)
0807 22:41:50.006341 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:50.006354 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:50.006490 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:50.006768 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:50.006770 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:50.006786 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:50.006934 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:50.006941 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.007689 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.007694 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:50.008700 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:50.008710 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.009538 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.009541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:50.009647 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.009677 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 22:41:50.009768 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 22:41:50.009847 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":40,"thread_start_us":131,"threads_started":1}
I20260807 22:41:50.010154 13252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.006207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:40885 (local address 127.26.52.67:40679)
0807 22:41:50.006384 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:50.006388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:50.006544 (+ 156us) server_negotiation.cc:407] Connection header received
0807 22:41:50.006696 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:50.006699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:50.006749 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:50.006833 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:50.007132 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.007633 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.008840 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.009511 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.009679 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.009736 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:50.009945 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 22:41:50.010020 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:41:50.010212 13262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.005961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:40679 (local address 127.26.52.65:40885)
0807 22:41:50.006447 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:50.006464 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:50.006587 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:50.006845 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:50.006847 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:50.006863 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:50.007023 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:50.007028 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.007745 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.007749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:50.008711 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:50.008721 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.009676 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.009680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:50.009800 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.009829 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 22:41:50.009924 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 22:41:50.010020 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":45,"thread_start_us":119,"threads_started":1}
I20260807 22:41:50.010883 13038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1436ca3bc3449d7af8cc59adc98c705" candidate_uuid: "f1004f327bce4355bfca99da1b9bebeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e018f637d8064a38b066312ea1ba432f" is_pre_election: true
I20260807 22:41:50.010947 13185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1436ca3bc3449d7af8cc59adc98c705" candidate_uuid: "f1004f327bce4355bfca99da1b9bebeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcafd35e37124c99a718c27455711822" is_pre_election: true
I20260807 22:41:50.011240 13038 raft_consensus.cc:2454] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1004f327bce4355bfca99da1b9bebeb in term 0.
I20260807 22:41:50.011262 13185 raft_consensus.cc:2454] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1004f327bce4355bfca99da1b9bebeb in term 0.
I20260807 22:41:50.011767 12827 leader_election.cc:302] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcafd35e37124c99a718c27455711822, f1004f327bce4355bfca99da1b9bebeb; no voters:
I20260807 22:41:50.012080 13259 raft_consensus.cc:2781] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:41:50.012204 13259 raft_consensus.cc:482] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:41:50.012261 13259 raft_consensus.cc:3037] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:50.013361 13259 raft_consensus.cc:504] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 } } peers { permanent_uuid: "f1004f327bce4355bfca99da1b9bebeb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 35243 } } peers { permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 } }
I20260807 22:41:50.013739 13259 leader_election.cc:288] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [CANDIDATE]: Term 1 election: Requested vote from peers e018f637d8064a38b066312ea1ba432f (127.26.52.66:44975), dcafd35e37124c99a718c27455711822 (127.26.52.67:40679)
I20260807 22:41:50.014140 13038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1436ca3bc3449d7af8cc59adc98c705" candidate_uuid: "f1004f327bce4355bfca99da1b9bebeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e018f637d8064a38b066312ea1ba432f"
I20260807 22:41:50.014151 13185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1436ca3bc3449d7af8cc59adc98c705" candidate_uuid: "f1004f327bce4355bfca99da1b9bebeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcafd35e37124c99a718c27455711822"
I20260807 22:41:50.014281 13038 raft_consensus.cc:3037] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:50.014314 13185 raft_consensus.cc:3037] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:50.015621 13038 raft_consensus.cc:2454] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1004f327bce4355bfca99da1b9bebeb in term 1.
I20260807 22:41:50.015668 13185 raft_consensus.cc:2454] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1004f327bce4355bfca99da1b9bebeb in term 1.
I20260807 22:41:50.016048 12827 leader_election.cc:302] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcafd35e37124c99a718c27455711822, f1004f327bce4355bfca99da1b9bebeb; no voters:
I20260807 22:41:50.016255 13259 raft_consensus.cc:2781] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:50.016511 13259 raft_consensus.cc:686] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [term 1 LEADER]: Becoming Leader. State: Replica: f1004f327bce4355bfca99da1b9bebeb, State: Running, Role: LEADER
I20260807 22:41:50.016911 13259 consensus_queue.cc:237] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 } } peers { permanent_uuid: "f1004f327bce4355bfca99da1b9bebeb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 35243 } } peers { permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 } }
I20260807 22:41:50.020632 12742 catalog_manager.cc:5495] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb reported cstate change: term changed from 0 to 1, leader changed from <none> to f1004f327bce4355bfca99da1b9bebeb (127.26.52.65). New cstate: current_term: 1 leader_uuid: "f1004f327bce4355bfca99da1b9bebeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1004f327bce4355bfca99da1b9bebeb" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 35243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 } health_report { overall_health: UNKNOWN } } }
I20260807 22:41:50.040408 13251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.036980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44220 (local address 127.26.52.65:35243)
0807 22:41:50.037110 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:50.037113 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:50.037127 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:41:50.037205 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:50.037207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:50.037263 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:50.037367 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:41:50.037594 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.038097 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.038922 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.039128 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.039208 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.039543 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:41:50.039985 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:41:50.040078 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:50.040218 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 22:41:50.040272 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:41:50.046653 13038 raft_consensus.cc:1261] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f [term 1 FOLLOWER]: Refusing update from remote peer f1004f327bce4355bfca99da1b9bebeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:50.046661 13185 raft_consensus.cc:1261] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822 [term 1 FOLLOWER]: Refusing update from remote peer f1004f327bce4355bfca99da1b9bebeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:50.047346 13259 consensus_queue.cc:1035] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e018f637d8064a38b066312ea1ba432f" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 44975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:50.047577 13264 consensus_queue.cc:1035] T c1436ca3bc3449d7af8cc59adc98c705 P f1004f327bce4355bfca99da1b9bebeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcafd35e37124c99a718c27455711822" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:50.056306 13269 mvcc.cc:205] Tried to move back new op lower bound from 7316039721142886400 to 7316039721032458240. Current Snapshot: MvccSnapshot[applied={T|T < 7316039721142886400}]
I20260807 22:41:50.065693 12743 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:50.065876 12743 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:50.068707 12743 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a7743cd401f543f6a89a93d7e8ac3d00: Sending DeleteTablet for 3 replicas of tablet c1436ca3bc3449d7af8cc59adc98c705
I20260807 22:41:50.069582 13016 tablet_service.cc:1514] Processing DeleteTablet for tablet c1436ca3bc3449d7af8cc59adc98c705 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:50 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:32878
I20260807 22:41:50.069615 12877 tablet_service.cc:1514] Processing DeleteTablet for tablet c1436ca3bc3449d7af8cc59adc98c705 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:50 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:44214
I20260807 22:41:50.069751 13165 tablet_service.cc:1514] Processing DeleteTablet for tablet c1436ca3bc3449d7af8cc59adc98c705 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:50 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:45180
I20260807 22:41:50.070369 13280 tablet_replica.cc:330] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: stopping tablet replica
I20260807 22:41:50.070534 13278 tablet_replica.cc:330] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: stopping tablet replica
I20260807 22:41:50.070798 13280 raft_consensus.cc:2229] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:50.070930 13278 raft_consensus.cc:2229] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:50.071159 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 12809
I20260807 22:41:50.071329 13278 raft_consensus.cc:2258] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:50.074848 13280 raft_consensus.cc:2258] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:50.076856 13280 ts_tablet_manager.cc:1905] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:50.077580 13278 ts_tablet_manager.cc:1905] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:50.080181 13278 ts_tablet_manager.cc:1918] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:50.080307 13278 log.cc:1196] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/c1436ca3bc3449d7af8cc59adc98c705
I20260807 22:41:50.080631 13280 ts_tablet_manager.cc:1918] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:50.080677 13278 ts_tablet_manager.cc:1939] T c1436ca3bc3449d7af8cc59adc98c705 P e018f637d8064a38b066312ea1ba432f: Deleting consensus metadata
I20260807 22:41:50.080746 13280 log.cc:1196] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/c1436ca3bc3449d7af8cc59adc98c705
I20260807 22:41:50.081121 13280 ts_tablet_manager.cc:1939] T c1436ca3bc3449d7af8cc59adc98c705 P dcafd35e37124c99a718c27455711822: Deleting consensus metadata
I20260807 22:41:50.082052 12731 catalog_manager.cc:4841] TS e018f637d8064a38b066312ea1ba432f (127.26.52.66:44975): tablet c1436ca3bc3449d7af8cc59adc98c705 (table test-table [id=ad6393c4a9644d9f9bd31df6ce89a84f]) successfully deleted
I20260807 22:41:50.082345 12728 catalog_manager.cc:4841] TS dcafd35e37124c99a718c27455711822 (127.26.52.67:40679): tablet c1436ca3bc3449d7af8cc59adc98c705 (table test-table [id=ad6393c4a9644d9f9bd31df6ce89a84f]) successfully deleted
W20260807 22:41:50.084815 12730 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:35243 (error 108)
I20260807 22:41:50.085004 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 12950
I20260807 22:41:50.088384 13250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.088011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:35243 (local address 127.0.0.1:44232)
0807 22:41:50.088228 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:50.088302 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:35243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 22:41:50.088687 12730 catalog_manager.cc:4584] TS f1004f327bce4355bfca99da1b9bebeb (127.26.52.65:35243): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c1436ca3bc3449d7af8cc59adc98c705: Network error: Client connection negotiation failed: client connection to 127.26.52.65:35243: connect: Connection refused (error 111)
I20260807 22:41:50.093808 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 13096
I20260807 22:41:50.101634 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 12710
2026-08-07T22:41:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2372 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T22:41:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:41:50Z Disabled control of system clock
I20260807 22:41:50.137401 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:46595
--webserver_interface=127.26.52.126
--webserver_port=0
--builtin_ntp_servers=127.26.52.84:44931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:46595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:41:50.252269 13285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:50.252570 13285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:50.252609 13285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:50.258044 13285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:50.258157 13285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:50.258188 13285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:50.258224 13285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:50.258256 13285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:50.263376 13285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:46595
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:46595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:50.264664 13285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:50.266127 13285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:50.275282 13293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:50.275283 13290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:50.275321 13291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:50.275720 13285 server_base.cc:1034] running on GCE node
I20260807 22:41:50.276429 13285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:50.277647 13285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:50.278820 13285 hybrid_clock.cc:648] HybridClock initialized: now 1786142510278800 us; error 34 us; skew 500 ppm
I20260807 22:41:50.280900 13285 webserver.cc:460] Webserver started at http://127.26.52.126:41199/ using document root <none> and password file <none>
I20260807 22:41:50.281553 13285 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:50.281625 13285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:50.281884 13285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:50.284303 13285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "e482bd4813c34c93b6db839476ea46ea"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "906ec8ad794ce402cc9144ee107f1400"
server_key_iv: "afb18c70d6d938f4f54b36086ac2a7d2"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.284919 13285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "e482bd4813c34c93b6db839476ea46ea"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "906ec8ad794ce402cc9144ee107f1400"
server_key_iv: "afb18c70d6d938f4f54b36086ac2a7d2"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.288851 13285 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:41:50.291473 13299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:50.292840 13285 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:41:50.293004 13285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "e482bd4813c34c93b6db839476ea46ea"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "906ec8ad794ce402cc9144ee107f1400"
server_key_iv: "afb18c70d6d938f4f54b36086ac2a7d2"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.293129 13285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:50.317791 13285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:50.318598 13285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:50.318819 13285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:50.326538 13285 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:46595
I20260807 22:41:50.326543 13352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:46595 every 8 connection(s)
I20260807 22:41:50.327643 13285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:50.331121 13353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:50.334285 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 13285
I20260807 22:41:50.334463 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:41:50.334765 26833 external_mini_cluster.cc:1428] Setting key ba44e2875366ce28e6bb6ec43a553e2a
I20260807 22:41:50.337627 13353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea: Bootstrap starting.
I20260807 22:41:50.340303 13353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:50.341248 13353 log.cc:824] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:50.343389 13353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea: No bootstrap required, opened a new log
I20260807 22:41:50.344584 13358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.336302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47792 (local address 127.26.52.126:46595)
0807 22:41:50.336959 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:50.336976 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:50.337016 (+ 40us) server_negotiation.cc:407] Connection header received
0807 22:41:50.337678 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:50.337695 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:50.338163 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:50.338454 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:50.338815 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.339800 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.341075 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.341616 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.341794 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.342719 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:50.342725 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:50.342739 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:50.343142 (+ 403us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:50.343201 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:50.343220 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:50.343333 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:50.343500 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 22:41:50.343767 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":132,"threads_started":1}
I20260807 22:41:50.347757 13353 raft_consensus.cc:348] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e482bd4813c34c93b6db839476ea46ea" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46595 } }
I20260807 22:41:50.348026 13353 raft_consensus.cc:374] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:50.348109 13353 raft_consensus.cc:729] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e482bd4813c34c93b6db839476ea46ea, State: Initialized, Role: FOLLOWER
I20260807 22:41:50.348589 13353 consensus_queue.cc:260] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e482bd4813c34c93b6db839476ea46ea" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46595 } }
I20260807 22:41:50.348747 13353 raft_consensus.cc:388] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:50.348837 13353 raft_consensus.cc:482] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:50.348956 13353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:50.349957 13353 raft_consensus.cc:504] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e482bd4813c34c93b6db839476ea46ea" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46595 } }
I20260807 22:41:50.350339 13353 leader_election.cc:302] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e482bd4813c34c93b6db839476ea46ea; no voters:
I20260807 22:41:50.350689 13353 leader_election.cc:288] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:41:50.350831 13360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:50.351090 13360 raft_consensus.cc:686] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [term 1 LEADER]: Becoming Leader. State: Replica: e482bd4813c34c93b6db839476ea46ea, State: Running, Role: LEADER
I20260807 22:41:50.351478 13360 consensus_queue.cc:237] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e482bd4813c34c93b6db839476ea46ea" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46595 } }
I20260807 22:41:50.352013 13353 sys_catalog.cc:564] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:50.353343 13362 sys_catalog.cc:455] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader e482bd4813c34c93b6db839476ea46ea. Latest consensus state: current_term: 1 leader_uuid: "e482bd4813c34c93b6db839476ea46ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e482bd4813c34c93b6db839476ea46ea" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46595 } } }
I20260807 22:41:50.353482 13362 sys_catalog.cc:458] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:50.353845 13361 sys_catalog.cc:455] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e482bd4813c34c93b6db839476ea46ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e482bd4813c34c93b6db839476ea46ea" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46595 } } }
I20260807 22:41:50.353971 13361 sys_catalog.cc:458] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:50.354044 13370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:50.357451 13370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:50.362890 13370 catalog_manager.cc:1347] Generated new cluster ID: 3f1ff465689c42888cf2f209d684b4c6
I20260807 22:41:50.362969 13370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:50.372177 13370 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:41:50.373167 13370 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:50.385345 13370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea: Generated new TSK 0
I20260807 22:41:50.386279 13370 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:41:50.390949 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46595
--builtin_ntp_servers=127.26.52.84:44931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:41:50.511075 13380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:50.511358 13380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:50.511399 13380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:50.515576 13380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:50.515640 13380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:50.515697 13380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:41:50.520736 13380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:50.521912 13380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:50.523372 13380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:50.533669 13388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:50.533651 13386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:50.533672 13385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:50.533859 13380 server_base.cc:1034] running on GCE node
I20260807 22:41:50.534348 13380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:50.534986 13380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:50.536188 13380 hybrid_clock.cc:648] HybridClock initialized: now 1786142510536174 us; error 25 us; skew 500 ppm
I20260807 22:41:50.538107 13380 webserver.cc:460] Webserver started at http://127.26.52.65:36595/ using document root <none> and password file <none>
I20260807 22:41:50.538676 13380 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:50.538736 13380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:50.538908 13380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:50.541046 13380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "87685f6e2f6b46bd831f738ca09cfbc9"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "aea89b1a3b89f0d526e06e5ee106974a"
server_key_iv: "0c20c542603147cf882e7694ab5905d0"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.541564 13380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "87685f6e2f6b46bd831f738ca09cfbc9"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "aea89b1a3b89f0d526e06e5ee106974a"
server_key_iv: "0c20c542603147cf882e7694ab5905d0"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.545334 13380 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:41:50.547804 13394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:50.549162 13380 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:41:50.549265 13380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "87685f6e2f6b46bd831f738ca09cfbc9"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "aea89b1a3b89f0d526e06e5ee106974a"
server_key_iv: "0c20c542603147cf882e7694ab5905d0"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.549360 13380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:50.569000 13380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:50.569703 13380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:50.569864 13380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:50.570564 13380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:50.571658 13380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:50.571707 13380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:50.571748 13380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:50.571763 13380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:50.580978 13380 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:40561
I20260807 22:41:50.581010 13514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:40561 every 8 connection(s)
I20260807 22:41:50.581928 13380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:50.588824 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 13380
I20260807 22:41:50.588953 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:41:50.589323 26833 external_mini_cluster.cc:1428] Setting key 8482b13011a3daff0cca4474cb2cbd60
I20260807 22:41:50.591563 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46595
--builtin_ntp_servers=127.26.52.84:44931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:41:50.591830 13358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.583824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:39441 (local address 127.26.52.126:46595)
0807 22:41:50.584010 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:50.584018 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:50.585046 (+ 1028us) server_negotiation.cc:407] Connection header received
0807 22:41:50.586484 (+ 1438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:50.586488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:50.586551 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:50.586630 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:50.587530 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.588085 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.589483 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.589816 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.589962 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.591266 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:50.591269 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:50.591272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:50.591286 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:50.591312 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:50.591321 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:50.591419 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:50.591597 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 22:41:50.591671 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:41:50.592748 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.584242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46595 (local address 127.26.52.65:39441)
0807 22:41:50.584883 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:50.584927 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:50.586245 (+ 1318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:50.586797 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:50.586804 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:50.586886 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:50.587374 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:50.587386 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.588265 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.588270 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:50.589318 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:50.589329 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.589995 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.589999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:50.590227 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.590969 (+ 742us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:50.590971 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:50.591027 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:50.591111 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:50.591421 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:50.591440 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:50.591448 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:41:50.591595 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 22:41:50.591914 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":117,"threads_started":1}
I20260807 22:41:50.594074 13516 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46595
I20260807 22:41:50.594358 13516 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:50.594926 13516 heartbeater.cc:511] Master 127.26.52.126:46595 requested a full tablet report, sending...
I20260807 22:41:50.596531 13316 ts_manager.cc:194] Registered new tserver with Master: 87685f6e2f6b46bd831f738ca09cfbc9 (127.26.52.65:40561)
I20260807 22:41:50.597885 13316 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.65:39441
W20260807 22:41:50.709578 13519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:50.709878 13519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:50.709929 13519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:50.714098 13519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:50.714164 13519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:50.714267 13519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:41:50.719260 13519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:50.720546 13519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:50.722142 13519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:50.732281 13524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:50.732291 13525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:50.732512 13527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:50.732553 13519 server_base.cc:1034] running on GCE node
I20260807 22:41:50.733012 13519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:50.733728 13519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:50.734910 13519 hybrid_clock.cc:648] HybridClock initialized: now 1786142510734876 us; error 47 us; skew 500 ppm
I20260807 22:41:50.736968 13519 webserver.cc:460] Webserver started at http://127.26.52.66:36467/ using document root <none> and password file <none>
I20260807 22:41:50.737584 13519 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:50.737649 13519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:50.737923 13519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:50.740391 13519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "6a626fa24ef04f74bc2333697c9e1932"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "5d873b267d417619d79469cd2b645a97"
server_key_iv: "35be1d89d1f65dd2f13d6cd0b3289dec"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.741053 13519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "6a626fa24ef04f74bc2333697c9e1932"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "5d873b267d417619d79469cd2b645a97"
server_key_iv: "35be1d89d1f65dd2f13d6cd0b3289dec"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.745251 13519 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:41:50.748262 13533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:50.749730 13519 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:41:50.749890 13519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "6a626fa24ef04f74bc2333697c9e1932"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "5d873b267d417619d79469cd2b645a97"
server_key_iv: "35be1d89d1f65dd2f13d6cd0b3289dec"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.750031 13519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:50.770303 13519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:50.771118 13519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:50.771345 13519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:50.771999 13519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:50.773108 13519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:50.773181 13519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:50.773257 13519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:50.773298 13519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:50.783093 13519 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:36815
I20260807 22:41:50.783113 13653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:36815 every 8 connection(s)
I20260807 22:41:50.784081 13519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:50.790714 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 13519
I20260807 22:41:50.790861 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:41:50.791213 26833 external_mini_cluster.cc:1428] Setting key 77ad110c576b5c33fdbe43e7014e70bd
I20260807 22:41:50.793469 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46595
--builtin_ntp_servers=127.26.52.84:44931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:41:50.794355 13358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.786162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:44715 (local address 127.26.52.126:46595)
0807 22:41:50.786319 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:50.786323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:50.787452 (+ 1129us) server_negotiation.cc:407] Connection header received
0807 22:41:50.788916 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:50.788920 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:50.788981 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:50.789086 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:50.790093 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.790785 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.792083 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.792405 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.792533 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.793855 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:50.793858 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:50.793861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:50.793872 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:50.793892 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:50.793900 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:50.793978 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:50.794144 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 22:41:50.794209 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:41:50.795296 13656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.786588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46595 (local address 127.26.52.66:44715)
0807 22:41:50.787293 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:50.787335 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:50.788702 (+ 1367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:50.789265 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:50.789272 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:50.789358 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:50.789944 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:50.789958 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.790972 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.790981 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:50.791948 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:50.791960 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.792670 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.792673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:50.792831 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.793509 (+ 678us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:50.793511 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:50.793588 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:50.793692 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:50.793993 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:50.794003 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:50.794009 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:41:50.794144 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 22:41:50.794467 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":123,"threads_started":1}
I20260807 22:41:50.796581 13654 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46595
I20260807 22:41:50.796847 13654 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:50.797518 13654 heartbeater.cc:511] Master 127.26.52.126:46595 requested a full tablet report, sending...
I20260807 22:41:50.798870 13316 ts_manager.cc:194] Registered new tserver with Master: 6a626fa24ef04f74bc2333697c9e1932 (127.26.52.66:36815)
I20260807 22:41:50.799813 13316 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.66:44715
W20260807 22:41:50.912604 13657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:50.912875 13657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:50.912914 13657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:50.916909 13657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:50.916965 13657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:50.917018 13657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:41:50.921803 13657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:50.922930 13657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:50.924379 13657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:50.934312 13663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:50.934367 13664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:50.934309 13666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:50.934659 13657 server_base.cc:1034] running on GCE node
I20260807 22:41:50.935160 13657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:50.935837 13657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:50.937026 13657 hybrid_clock.cc:648] HybridClock initialized: now 1786142510936982 us; error 55 us; skew 500 ppm
I20260807 22:41:50.938858 13657 webserver.cc:460] Webserver started at http://127.26.52.67:45731/ using document root <none> and password file <none>
I20260807 22:41:50.939489 13657 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:50.939584 13657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:50.939824 13657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:50.941996 13657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "3227bf629fe043c5b67a31a1f5fccfdb"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "d975024ac1aa1796951288345f6e6ac3"
server_key_iv: "3f35aa98ea09ef49f8901854418fbd34"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.942587 13657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "3227bf629fe043c5b67a31a1f5fccfdb"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "d975024ac1aa1796951288345f6e6ac3"
server_key_iv: "3f35aa98ea09ef49f8901854418fbd34"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.946381 13657 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:41:50.948978 13673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:50.950193 13657 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:41:50.950326 13657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "3227bf629fe043c5b67a31a1f5fccfdb"
format_stamp: "Formatted at 2026-08-07 22:41:50 on dist-test-slave-8w9v"
server_key: "d975024ac1aa1796951288345f6e6ac3"
server_key_iv: "3f35aa98ea09ef49f8901854418fbd34"
server_key_version: "encryptionkey@0"
I20260807 22:41:50.950428 13657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:50.965013 13657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:50.965766 13657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:50.965981 13657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:50.966606 13657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:50.967603 13657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:50.967672 13657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:50.967747 13657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:50.967787 13657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:50.976415 13657 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:33865
I20260807 22:41:50.976477 13794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:33865 every 8 connection(s)
I20260807 22:41:50.977385 13657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:50.981812 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 13657
I20260807 22:41:50.981945 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:41:50.982318 26833 external_mini_cluster.cc:1428] Setting key f35f2860eb803dbcbf38a21e754440e9
I20260807 22:41:50.987325 13358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.979262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:47431 (local address 127.26.52.126:46595)
0807 22:41:50.979418 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:50.979423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:50.980566 (+ 1143us) server_negotiation.cc:407] Connection header received
0807 22:41:50.982157 (+ 1591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:50.982160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:50.982210 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:50.982288 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:50.983489 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.984088 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.985387 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.985618 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.985732 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.986822 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:50.986825 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:50.986827 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:50.986839 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:50.986858 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:50.986866 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:50.986948 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:50.987109 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 22:41:50.987176 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:41:50.988269 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.979721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46595 (local address 127.26.52.67:47431)
0807 22:41:50.980420 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:50.980464 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:50.981914 (+ 1450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:50.982523 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:50.982532 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:50.982636 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:50.983330 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:50.983351 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.984242 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.984246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:50.985261 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:50.985271 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.985779 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:50.985783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:50.985962 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:50.986547 (+ 585us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:50.986549 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:50.986591 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:50.986661 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:50.986950 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:50.986963 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:50.986970 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:41:50.987097 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 22:41:50.987385 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":122,"threads_started":1}
I20260807 22:41:50.989310 13795 heartbeater.cc:347] Connected to a master server at 127.26.52.126:46595
I20260807 22:41:50.989562 13795 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:50.990150 13795 heartbeater.cc:511] Master 127.26.52.126:46595 requested a full tablet report, sending...
I20260807 22:41:50.991143 13316 ts_manager.cc:194] Registered new tserver with Master: 3227bf629fe043c5b67a31a1f5fccfdb (127.26.52.67:33865)
I20260807 22:41:50.991708 13316 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.67:47431
I20260807 22:41:50.996266 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:41:51.002161 13358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:50.998262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47808 (local address 127.26.52.126:46595)
0807 22:41:50.998409 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:50.998413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:50.998608 (+ 195us) server_negotiation.cc:407] Connection header received
0807 22:41:50.998699 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:50.998701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:50.998741 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:50.998806 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:50.999054 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:50.999552 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.000653 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.000862 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.000955 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.001731 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:51.001734 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:51.001736 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:51.001746 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:51.001761 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:51.001768 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:51.001821 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:51.001920 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 22:41:51.001970 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:41:51.005030 13316 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47808:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:41:51.008088 13316 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:41:51.022636 13808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.016737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:33865 (local address 127.0.0.1:46700)
0807 22:41:51.017794 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:51.017848 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:51.017991 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:51.018712 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:51.018718 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:51.018740 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:51.018888 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:51.018895 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.019970 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.019976 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:51.021226 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:51.021236 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.022067 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.022070 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:51.022184 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.022227 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 22:41:51.022342 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 22:41:51.022469 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"spinlock_wait_cycles":9856,"thread_start_us":94,"threads_started":1}
I20260807 22:41:51.022646 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.016961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46700 (local address 127.26.52.67:33865)
0807 22:41:51.018303 (+ 1342us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:51.018312 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:51.018333 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:41:51.018392 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:51.018395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:51.018560 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:51.018719 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:51.019022 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.019842 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.021350 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.021954 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.022071 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.022269 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:51.022374 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 22:41:51.022474 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1234,"thread_start_us":127,"threads_started":1}
I20260807 22:41:51.023572 13809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.017152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40561 (local address 127.0.0.1:33564)
0807 22:41:51.017985 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:51.017998 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:51.018076 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:51.018881 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:51.018884 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:51.018899 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:51.018993 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:51.019001 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.020526 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.020529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:51.021759 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:51.021770 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.023096 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.023100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:51.023193 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.023218 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:41:51.023292 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:41:51.023360 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":779,"mutex_wait_us":28,"thread_start_us":101,"threads_started":1}
I20260807 22:41:51.023746 13813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.017576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33564 (local address 127.26.52.65:40561)
0807 22:41:51.018378 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:51.018388 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:51.018408 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:41:51.018473 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:51.018478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:51.018647 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:51.018797 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:51.019126 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.020395 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.021910 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.022744 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.022859 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.023014 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:51.023486 (+ 472us) server_negotiation.cc:299] Negotiation successful
0807 22:41:51.023586 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":121,"threads_started":1}
I20260807 22:41:51.023572 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.016928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:36815 (local address 127.0.0.1:55134)
0807 22:41:51.017794 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:51.017850 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:51.017989 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:51.018946 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:51.018971 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:51.018995 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:51.019088 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:51.019093 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.020526 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.020529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:51.021868 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:51.021879 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.023162 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.023165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:51.023249 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.023272 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:41:51.023337 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 22:41:51.023407 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"mutex_wait_us":214,"spinlock_wait_cycles":896,"thread_start_us":120,"threads_started":1}
I20260807 22:41:51.024444 13812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.017479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55134 (local address 127.26.52.66:36815)
0807 22:41:51.018306 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:51.018320 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:51.018343 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:41:51.018449 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:51.018454 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:51.018647 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:51.018797 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:51.019211 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.020371 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.021995 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.022769 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.022892 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.023098 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:51.023641 (+ 543us) server_negotiation.cc:299] Negotiation successful
0807 22:41:51.023752 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":161,"threads_started":1}
I20260807 22:41:51.026353 13445 tablet_service.cc:1467] Processing CreateTablet for tablet 512f2f97782b45d9baabd190feba63c4 (DEFAULT_TABLE table=test-table [id=e7938e575f76490ebc5376ff1f762eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:51.026368 13723 tablet_service.cc:1467] Processing CreateTablet for tablet 512f2f97782b45d9baabd190feba63c4 (DEFAULT_TABLE table=test-table [id=e7938e575f76490ebc5376ff1f762eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:51.027429 13445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 512f2f97782b45d9baabd190feba63c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:51.027438 13723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 512f2f97782b45d9baabd190feba63c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:51.027218 13585 tablet_service.cc:1467] Processing CreateTablet for tablet 512f2f97782b45d9baabd190feba63c4 (DEFAULT_TABLE table=test-table [id=e7938e575f76490ebc5376ff1f762eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:51.028237 13585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 512f2f97782b45d9baabd190feba63c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:51.034116 13814 tablet_bootstrap.cc:492] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9: Bootstrap starting.
I20260807 22:41:51.035604 13815 tablet_bootstrap.cc:492] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: Bootstrap starting.
I20260807 22:41:51.036492 13814 tablet_bootstrap.cc:654] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:51.037240 13814 log.cc:824] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:51.037631 13815 tablet_bootstrap.cc:654] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:51.037950 13816 tablet_bootstrap.cc:492] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: Bootstrap starting.
I20260807 22:41:51.038393 13815 log.cc:824] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:51.040165 13814 tablet_bootstrap.cc:492] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9: No bootstrap required, opened a new log
I20260807 22:41:51.040369 13815 tablet_bootstrap.cc:492] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: No bootstrap required, opened a new log
I20260807 22:41:51.040385 13814 ts_tablet_manager.cc:1397] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:41:51.040568 13815 ts_tablet_manager.cc:1397] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:41:51.040583 13816 tablet_bootstrap.cc:654] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:51.041427 13816 log.cc:824] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:51.043449 13816 tablet_bootstrap.cc:492] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: No bootstrap required, opened a new log
I20260807 22:41:51.043633 13816 ts_tablet_manager.cc:1397] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:41:51.044019 13814 raft_consensus.cc:348] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33865 } } peers { permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 } } peers { permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 } }
I20260807 22:41:51.044317 13814 raft_consensus.cc:374] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:51.044391 13814 raft_consensus.cc:729] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87685f6e2f6b46bd831f738ca09cfbc9, State: Initialized, Role: FOLLOWER
I20260807 22:41:51.044853 13814 consensus_queue.cc:260] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33865 } } peers { permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 } } peers { permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 } }
I20260807 22:41:51.044807 13815 raft_consensus.cc:348] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33865 } } peers { permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 } } peers { permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 } }
I20260807 22:41:51.045082 13815 raft_consensus.cc:374] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:51.045149 13815 raft_consensus.cc:729] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3227bf629fe043c5b67a31a1f5fccfdb, State: Initialized, Role: FOLLOWER
I20260807 22:41:51.045531 13516 heartbeater.cc:503] Master 127.26.52.126:46595 was elected leader, sending a full tablet report...
I20260807 22:41:51.045643 13815 consensus_queue.cc:260] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33865 } } peers { permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 } } peers { permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 } }
I20260807 22:41:51.045872 13814 ts_tablet_manager.cc:1428] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:41:51.046545 13815 ts_tablet_manager.cc:1428] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:41:51.046871 13795 heartbeater.cc:503] Master 127.26.52.126:46595 was elected leader, sending a full tablet report...
I20260807 22:41:51.048875 13816 raft_consensus.cc:348] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33865 } } peers { permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 } } peers { permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 } }
I20260807 22:41:51.049140 13816 raft_consensus.cc:374] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:51.049239 13816 raft_consensus.cc:729] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a626fa24ef04f74bc2333697c9e1932, State: Initialized, Role: FOLLOWER
I20260807 22:41:51.049688 13816 consensus_queue.cc:260] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33865 } } peers { permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 } } peers { permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 } }
I20260807 22:41:51.050298 13654 heartbeater.cc:503] Master 127.26.52.126:46595 was elected leader, sending a full tablet report...
I20260807 22:41:51.050652 13816 ts_tablet_manager.cc:1428] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
W20260807 22:41:51.083273 13517 tablet.cc:2369] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:41:51.228446 13797 tablet.cc:2369] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:41:51.285596 13655 tablet.cc:2369] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:41:51.303694 13821 raft_consensus.cc:482] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:51.303992 13821 raft_consensus.cc:504] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33865 } } peers { permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 } } peers { permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 } }
I20260807 22:41:51.305542 13821 leader_election.cc:288] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a626fa24ef04f74bc2333697c9e1932 (127.26.52.66:36815), 87685f6e2f6b46bd831f738ca09cfbc9 (127.26.52.65:40561)
I20260807 22:41:51.311599 13813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.306977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:43547 (local address 127.26.52.65:40561)
0807 22:41:51.307115 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:51.307119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:51.307132 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:41:51.307183 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:51.307186 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:51.307234 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:51.307313 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:51.307771 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.308664 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.310185 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.310898 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.311024 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.311088 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:51.311374 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 22:41:51.311464 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:41:51.311614 13823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.305859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40561 (local address 127.26.52.67:43547)
0807 22:41:51.306262 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:51.306277 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:51.306370 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:51.307405 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:51.307411 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:51.307438 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:51.307610 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:51.307619 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.308778 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.308784 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:51.309710 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:51.309720 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.311020 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.311028 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:51.311206 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.311253 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 22:41:51.311343 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:41:51.311422 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":166,"threads_started":1}
I20260807 22:41:51.311625 13812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.306240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:36131 (local address 127.26.52.66:36815)
0807 22:41:51.306432 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:51.306438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:51.306454 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:41:51.306517 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:51.306521 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:51.306586 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:51.306688 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:51.307027 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.307726 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.309353 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.309963 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.310073 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.310128 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:51.311417 (+ 1289us) server_negotiation.cc:299] Negotiation successful
0807 22:41:51.311494 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:41:51.311625 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.305752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:36815 (local address 127.26.52.67:36131)
0807 22:41:51.305936 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:51.305957 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:51.306044 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:51.306699 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:51.306706 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:51.306735 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:51.306870 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:51.306877 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.307859 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.307866 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:51.309208 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:51.309221 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.311164 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.311169 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:51.311287 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.311325 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 22:41:51.311398 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 22:41:51.311483 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260807 22:41:51.312891 13606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "512f2f97782b45d9baabd190feba63c4" candidate_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a626fa24ef04f74bc2333697c9e1932" is_pre_election: true
I20260807 22:41:51.312829 13465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "512f2f97782b45d9baabd190feba63c4" candidate_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" is_pre_election: true
I20260807 22:41:51.313230 13606 raft_consensus.cc:2454] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3227bf629fe043c5b67a31a1f5fccfdb in term 0.
I20260807 22:41:51.313230 13465 raft_consensus.cc:2454] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3227bf629fe043c5b67a31a1f5fccfdb in term 0.
I20260807 22:41:51.313759 13674 leader_election.cc:302] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3227bf629fe043c5b67a31a1f5fccfdb, 87685f6e2f6b46bd831f738ca09cfbc9; no voters:
I20260807 22:41:51.314092 13821 raft_consensus.cc:2781] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:41:51.314195 13821 raft_consensus.cc:482] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:41:51.314273 13821 raft_consensus.cc:3037] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:51.315541 13821 raft_consensus.cc:504] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33865 } } peers { permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 } } peers { permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 } }
I20260807 22:41:51.315913 13821 leader_election.cc:288] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [CANDIDATE]: Term 1 election: Requested vote from peers 6a626fa24ef04f74bc2333697c9e1932 (127.26.52.66:36815), 87685f6e2f6b46bd831f738ca09cfbc9 (127.26.52.65:40561)
I20260807 22:41:51.316340 13465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "512f2f97782b45d9baabd190feba63c4" candidate_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87685f6e2f6b46bd831f738ca09cfbc9"
I20260807 22:41:51.316473 13465 raft_consensus.cc:3037] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:51.317777 13465 raft_consensus.cc:2454] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3227bf629fe043c5b67a31a1f5fccfdb in term 1.
I20260807 22:41:51.318068 13606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "512f2f97782b45d9baabd190feba63c4" candidate_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a626fa24ef04f74bc2333697c9e1932"
I20260807 22:41:51.318107 13674 leader_election.cc:302] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3227bf629fe043c5b67a31a1f5fccfdb, 87685f6e2f6b46bd831f738ca09cfbc9; no voters:
I20260807 22:41:51.318193 13606 raft_consensus.cc:3037] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:51.318276 13821 raft_consensus.cc:2781] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:51.318512 13821 raft_consensus.cc:686] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 1 LEADER]: Becoming Leader. State: Replica: 3227bf629fe043c5b67a31a1f5fccfdb, State: Running, Role: LEADER
I20260807 22:41:51.318872 13821 consensus_queue.cc:237] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33865 } } peers { permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 } } peers { permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 } }
I20260807 22:41:51.319380 13606 raft_consensus.cc:2454] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3227bf629fe043c5b67a31a1f5fccfdb in term 1.
I20260807 22:41:51.322463 13315 catalog_manager.cc:5495] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb reported cstate change: term changed from 0 to 1, leader changed from <none> to 3227bf629fe043c5b67a31a1f5fccfdb (127.26.52.67). New cstate: current_term: 1 leader_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3227bf629fe043c5b67a31a1f5fccfdb" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 33865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 } health_report { overall_health: UNKNOWN } } }
I20260807 22:41:51.389631 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.385877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46712 (local address 127.26.52.67:33865)
0807 22:41:51.386027 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:51.386032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:51.386049 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:41:51.386184 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:51.386187 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:51.386242 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:51.386359 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:41:51.386621 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.387141 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.388022 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:51.388312 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:51.388427 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:51.388755 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:41:51.389208 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:41:51.389346 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:51.389388 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 22:41:51.389447 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 22:41:51.396024 13606 raft_consensus.cc:1261] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932 [term 1 FOLLOWER]: Refusing update from remote peer 3227bf629fe043c5b67a31a1f5fccfdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:51.396040 13465 raft_consensus.cc:1261] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9 [term 1 FOLLOWER]: Refusing update from remote peer 3227bf629fe043c5b67a31a1f5fccfdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:51.396827 13824 consensus_queue.cc:1035] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a626fa24ef04f74bc2333697c9e1932" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:51.397163 13821 consensus_queue.cc:1035] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "87685f6e2f6b46bd831f738ca09cfbc9" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 40561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:51.405918 13829 mvcc.cc:205] Tried to move back new op lower bound from 7316039726669713408 to 7316039726364790784. Current Snapshot: MvccSnapshot[applied={T|T < 7316039726669713408}]
I20260807 22:41:51.414366 13315 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47808:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:51.414570 13315 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47808:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:51.417237 13315 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e482bd4813c34c93b6db839476ea46ea: Sending DeleteTablet for 3 replicas of tablet 512f2f97782b45d9baabd190feba63c4
I20260807 22:41:51.418063 13723 tablet_service.cc:1514] Processing DeleteTablet for tablet 512f2f97782b45d9baabd190feba63c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:51 UTC) from {username='slave'} at 127.0.0.1:46700
I20260807 22:41:51.418164 13585 tablet_service.cc:1514] Processing DeleteTablet for tablet 512f2f97782b45d9baabd190feba63c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:51 UTC) from {username='slave'} at 127.0.0.1:55134
I20260807 22:41:51.418219 13445 tablet_service.cc:1514] Processing DeleteTablet for tablet 512f2f97782b45d9baabd190feba63c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:51 UTC) from {username='slave'} at 127.0.0.1:33564
I20260807 22:41:51.418607 13837 tablet_replica.cc:330] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: stopping tablet replica
I20260807 22:41:51.418953 13837 raft_consensus.cc:2229] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:41:51.419128 13838 tablet_replica.cc:330] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9: stopping tablet replica
I20260807 22:41:51.419209 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 13380
I20260807 22:41:51.419437 13838 raft_consensus.cc:2229] T 512f2f97782b45d9baabd190feba63c4 P 87685f6e2f6b46bd831f738ca09cfbc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:51.419910 13839 tablet_replica.cc:330] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: stopping tablet replica
I20260807 22:41:51.420315 13839 raft_consensus.cc:2229] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:51.420686 13839 raft_consensus.cc:2258] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:51.420697 13837 raft_consensus.cc:2258] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:51.422773 13837 ts_tablet_manager.cc:1905] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:51.425700 13837 ts_tablet_manager.cc:1918] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:51.425799 13837 log.cc:1196] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/512f2f97782b45d9baabd190feba63c4
I20260807 22:41:51.426110 13837 ts_tablet_manager.cc:1939] T 512f2f97782b45d9baabd190feba63c4 P 3227bf629fe043c5b67a31a1f5fccfdb: Deleting consensus metadata
I20260807 22:41:51.427824 13301 catalog_manager.cc:4841] TS 3227bf629fe043c5b67a31a1f5fccfdb (127.26.52.67:33865): tablet 512f2f97782b45d9baabd190feba63c4 (table test-table [id=e7938e575f76490ebc5376ff1f762eb9]) successfully deleted
I20260807 22:41:51.429610 13839 ts_tablet_manager.cc:1905] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:51.431754 13839 ts_tablet_manager.cc:1918] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:51.431875 13839 log.cc:1196] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/512f2f97782b45d9baabd190feba63c4
I20260807 22:41:51.432225 13839 ts_tablet_manager.cc:1939] T 512f2f97782b45d9baabd190feba63c4 P 6a626fa24ef04f74bc2333697c9e1932: Deleting consensus metadata
W20260807 22:41:51.435516 13300 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:40561 (error 108)
I20260807 22:41:51.436685 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.436365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:40561 (local address 127.0.0.1:33568)
0807 22:41:51.436516 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:51.436593 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:40561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 22:41:51.436739 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 13519
W20260807 22:41:51.436908 13300 catalog_manager.cc:4584] TS 87685f6e2f6b46bd831f738ca09cfbc9 (127.26.52.65:40561): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 512f2f97782b45d9baabd190feba63c4: Network error: Client connection negotiation failed: client connection to 127.26.52.65:40561: connect: Connection refused (error 111)
I20260807 22:41:51.447089 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 13657
I20260807 22:41:51.447362 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:51.447025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:36815 (local address 127.0.0.1:55150)
0807 22:41:51.447187 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:51.447249 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.66:36815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 22:41:51.455197 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 13285
2026-08-07T22:41:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1351 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:41:51 dist-test-slave-8w9v krb5kdc[13845](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:41:51 dist-test-slave-8w9v krb5kdc[13845](info): set up 2 sockets
Aug 07 22:41:51 dist-test-slave-8w9v krb5kdc[13845](info): commencing operation
krb5kdc: starting...
W20260807 22:41:52.534494 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:41:52 dist-test-slave-8w9v krb5kdc[13845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:41:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:41:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:41:52.663488 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37403
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:37403
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:52.779471 13858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:52.779804 13858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:52.779884 13858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:52.784595 13858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:52.784690 13858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:52.784729 13858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:52.784768 13858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:52.784803 13858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:52.790360 13858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:37403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:37403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:52.791553 13858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:52.792665 13858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:52.802096 13864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:52.802567 13867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:52.803736 13865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:52.804517 13858 server_base.cc:1034] running on GCE node
I20260807 22:41:52.805183 13858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:52.806857 13858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:52.808094 13858 hybrid_clock.cc:648] HybridClock initialized: now 1786142512808066 us; error 43 us; skew 500 ppm
Aug 07 22:41:52 dist-test-slave-8w9v krb5kdc[13845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142512, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:52.811587 13858 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:41:52.812644 13858 webserver.cc:460] Webserver started at http://127.26.52.126:33301/ using document root <none> and password file <none>
I20260807 22:41:52.813253 13858 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:52.813347 13858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:52.813599 13858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:52.815766 13858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "796878a192f64363af9540fc40a18d0e"
format_stamp: "Formatted at 2026-08-07 22:41:52 on dist-test-slave-8w9v"
server_key: "5b5ae517b37f9dfcdc3764f7f832baa1"
server_key_iv: "7b0a31483f77de9103f1418b16eb7c2d"
server_key_version: "encryptionkey@0"
I20260807 22:41:52.816395 13858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "796878a192f64363af9540fc40a18d0e"
format_stamp: "Formatted at 2026-08-07 22:41:52 on dist-test-slave-8w9v"
server_key: "5b5ae517b37f9dfcdc3764f7f832baa1"
server_key_iv: "7b0a31483f77de9103f1418b16eb7c2d"
server_key_version: "encryptionkey@0"
I20260807 22:41:52.820246 13858 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:41:52.822738 13875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:52.823935 13858 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:41:52.824074 13858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "796878a192f64363af9540fc40a18d0e"
format_stamp: "Formatted at 2026-08-07 22:41:52 on dist-test-slave-8w9v"
server_key: "5b5ae517b37f9dfcdc3764f7f832baa1"
server_key_iv: "7b0a31483f77de9103f1418b16eb7c2d"
server_key_version: "encryptionkey@0"
I20260807 22:41:52.824259 13858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:52.837169 13858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:52.839977 13858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:52.840252 13858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:52.847573 13858 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:37403
I20260807 22:41:52.847604 13932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:37403 every 8 connection(s)
I20260807 22:41:52.848583 13858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:52.850766 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 13858
I20260807 22:41:52.850912 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:41:52.851207 26833 external_mini_cluster.cc:1428] Setting key 7170cf3d9955b7d6f61d4eddd218908b
I20260807 22:41:52.851572 13933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:52.858012 13933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e: Bootstrap starting.
Aug 07 22:41:52 dist-test-slave-8w9v krb5kdc[13845](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:52.860807 13933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:52.861713 13933 log.cc:824] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:52.864219 13933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e: No bootstrap required, opened a new log
I20260807 22:41:52.866147 13936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:52.852729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34494 (local address 127.26.52.126:37403)
0807 22:41:52.853183 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:52.853198 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:52.853236 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:41:52.853878 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:52.853903 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:52.854213 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:52.854543 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:52.855411 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:52.856538 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:52.857406 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:52.857884 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:52.858071 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:52.860938 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:52.860945 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:52.860958 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:52.860989 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:52.862935 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:52.863464 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:52.863469 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:52.863474 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:52.863581 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:52.863879 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:52.863882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:52.863883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:52.864378 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:52.864556 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:52.864867 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 22:41:52.865181 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":153,"threads_started":1}
I20260807 22:41:52.867636 13933 raft_consensus.cc:348] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "796878a192f64363af9540fc40a18d0e" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37403 } }
I20260807 22:41:52.867919 13933 raft_consensus.cc:374] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:52.867981 13933 raft_consensus.cc:729] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 796878a192f64363af9540fc40a18d0e, State: Initialized, Role: FOLLOWER
I20260807 22:41:52.868471 13933 consensus_queue.cc:260] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "796878a192f64363af9540fc40a18d0e" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37403 } }
I20260807 22:41:52.868628 13933 raft_consensus.cc:388] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:52.868710 13933 raft_consensus.cc:482] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:52.868829 13933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:52.869760 13933 raft_consensus.cc:504] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "796878a192f64363af9540fc40a18d0e" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37403 } }
I20260807 22:41:52.870100 13933 leader_election.cc:302] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 796878a192f64363af9540fc40a18d0e; no voters:
I20260807 22:41:52.870406 13933 leader_election.cc:288] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:41:52.870560 13938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:52.871078 13938 raft_consensus.cc:686] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [term 1 LEADER]: Becoming Leader. State: Replica: 796878a192f64363af9540fc40a18d0e, State: Running, Role: LEADER
I20260807 22:41:52.871479 13938 consensus_queue.cc:237] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "796878a192f64363af9540fc40a18d0e" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37403 } }
I20260807 22:41:52.871750 13933 sys_catalog.cc:564] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:52.873211 13940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 796878a192f64363af9540fc40a18d0e. Latest consensus state: current_term: 1 leader_uuid: "796878a192f64363af9540fc40a18d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "796878a192f64363af9540fc40a18d0e" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37403 } } }
I20260807 22:41:52.873267 13939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "796878a192f64363af9540fc40a18d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "796878a192f64363af9540fc40a18d0e" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 37403 } } }
I20260807 22:41:52.873337 13940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:52.873395 13939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e [sys.catalog]: This master's current role is: LEADER
W20260807 22:41:52.876834 13954 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:41:52.876937 13954 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:41:52.877010 13950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:52.877746 13950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:52.884455 13950 catalog_manager.cc:1347] Generated new cluster ID: 936665dba69a475795400393a0a4e7ff
I20260807 22:41:52.884536 13950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:52.908613 13950 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:41:52.909981 13950 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:52.915203 13950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e: Generated new TSK 0
I20260807 22:41:52.916042 13950 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:41:52.945598 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37403
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:53.061118 13960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:53.061431 13960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:53.061507 13960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:53.065620 13960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:53.065706 13960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:53.065798 13960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:41:53.071621 13960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:53.072875 13960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:53.074014 13960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:53.083894 13968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:53.083925 13965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:53.083894 13966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:53.084151 13960 server_base.cc:1034] running on GCE node
I20260807 22:41:53.084652 13960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:53.085361 13960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:53.086555 13960 hybrid_clock.cc:648] HybridClock initialized: now 1786142513086539 us; error 29 us; skew 500 ppm
Aug 07 22:41:53 dist-test-slave-8w9v krb5kdc[13845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142513, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:53.089425 13960 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:41:53.090363 13960 webserver.cc:460] Webserver started at http://127.26.52.65:40515/ using document root <none> and password file <none>
I20260807 22:41:53.090969 13960 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:53.091033 13960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:53.091279 13960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:53.093478 13960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "f43227baf4e841f1b7d6bc7f8efa2756"
format_stamp: "Formatted at 2026-08-07 22:41:53 on dist-test-slave-8w9v"
server_key: "744b80e20626479d624036ad239055a6"
server_key_iv: "68825ff5da653f3702dfbb6e1bd76aa6"
server_key_version: "encryptionkey@0"
I20260807 22:41:53.094059 13960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "f43227baf4e841f1b7d6bc7f8efa2756"
format_stamp: "Formatted at 2026-08-07 22:41:53 on dist-test-slave-8w9v"
server_key: "744b80e20626479d624036ad239055a6"
server_key_iv: "68825ff5da653f3702dfbb6e1bd76aa6"
server_key_version: "encryptionkey@0"
I20260807 22:41:53.098018 13960 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:41:53.100543 13975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:53.101789 13960 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:41:53.101928 13960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "f43227baf4e841f1b7d6bc7f8efa2756"
format_stamp: "Formatted at 2026-08-07 22:41:53 on dist-test-slave-8w9v"
server_key: "744b80e20626479d624036ad239055a6"
server_key_iv: "68825ff5da653f3702dfbb6e1bd76aa6"
server_key_version: "encryptionkey@0"
I20260807 22:41:53.102039 13960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:53.112630 13960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:53.115716 13960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:53.115933 13960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:53.116672 13960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:53.117554 13960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:53.117604 13960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:53.117669 13960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:53.117702 13960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:53.126917 13960 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:34895
I20260807 22:41:53.126943 14096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:34895 every 8 connection(s)
I20260807 22:41:53.127914 13960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:53.133055 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 13960
I20260807 22:41:53.133210 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:41:53.133541 26833 external_mini_cluster.cc:1428] Setting key 5e61aac82c0c6db7486a1c8709ba7f8c
Aug 07 22:41:53 dist-test-slave-8w9v krb5kdc[13845](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142513, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:53.143258 13936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.129959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:49953 (local address 127.26.52.126:37403)
0807 22:41:53.130108 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:53.130112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:53.131178 (+ 1066us) server_negotiation.cc:407] Connection header received
0807 22:41:53.132071 (+ 893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:53.132075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:53.132167 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:53.132273 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:53.133811 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.134525 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.136218 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.136451 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.136537 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.139256 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:53.139260 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:53.139262 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:53.139286 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:53.140837 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:53.141498 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:53.141501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:53.141502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:53.141587 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:53.142054 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:53.142056 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:53.142058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:53.142247 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:53.142335 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:53.143010 (+ 675us) server_negotiation.cc:299] Negotiation successful
0807 22:41:53.143127 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:41:53.144572 14099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.130359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37403 (local address 127.26.52.65:49953)
0807 22:41:53.131035 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:53.131076 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:53.131869 (+ 793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:53.132448 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:53.132454 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:53.132900 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:53.133603 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.133626 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.134668 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.134671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.136060 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.136075 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.136611 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.136618 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.136862 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.137616 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:53.137632 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:53.139081 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:53.140963 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:53.140973 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:53.140994 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:53.141383 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:53.141710 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:53.141715 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:53.141720 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:53.141944 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:53.142361 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:53.142370 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:53.142726 (+ 356us) client_negotiation.cc:769] Sending connection context
0807 22:41:53.142980 (+ 254us) client_negotiation.cc:240] Negotiation successful
0807 22:41:53.143364 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":130,"threads_started":1}
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:41:53.145876 14097 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37403
I20260807 22:41:53.146127 14097 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:53.146646 14097 heartbeater.cc:511] Master 127.26.52.126:37403 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:41:53.148307 13893 ts_manager.cc:194] Registered new tserver with Master: f43227baf4e841f1b7d6bc7f8efa2756 (127.26.52.65:34895)
I20260807 22:41:53.149576 13893 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:49953
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:41:53.164496 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37403
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:53.279819 14103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:53.280181 14103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:53.280288 14103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:53.284663 14103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:53.284731 14103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:53.284832 14103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:41:53.290247 14103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:53.291391 14103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:53.292514 14103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:53.302590 14108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:53.302603 14109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:53.302590 14111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:53.302929 14103 server_base.cc:1034] running on GCE node
I20260807 22:41:53.303337 14103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:53.304013 14103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:53.305194 14103 hybrid_clock.cc:648] HybridClock initialized: now 1786142513305177 us; error 28 us; skew 500 ppm
Aug 07 22:41:53 dist-test-slave-8w9v krb5kdc[13845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142513, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:53.308012 14103 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:41:53.309103 14103 webserver.cc:460] Webserver started at http://127.26.52.66:36135/ using document root <none> and password file <none>
I20260807 22:41:53.309720 14103 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:53.309813 14103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:53.310060 14103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:53.312317 14103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "0e092018418d464f83a84c1cd9e8357b"
format_stamp: "Formatted at 2026-08-07 22:41:53 on dist-test-slave-8w9v"
server_key: "0e8b126384155ba3eb30b7898343cb68"
server_key_iv: "dd44fb42c143d30582e3fbd45cd552a5"
server_key_version: "encryptionkey@0"
I20260807 22:41:53.312912 14103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "0e092018418d464f83a84c1cd9e8357b"
format_stamp: "Formatted at 2026-08-07 22:41:53 on dist-test-slave-8w9v"
server_key: "0e8b126384155ba3eb30b7898343cb68"
server_key_iv: "dd44fb42c143d30582e3fbd45cd552a5"
server_key_version: "encryptionkey@0"
I20260807 22:41:53.316949 14103 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:41:53.319438 14119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:53.320703 14103 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:41:53.320863 14103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "0e092018418d464f83a84c1cd9e8357b"
format_stamp: "Formatted at 2026-08-07 22:41:53 on dist-test-slave-8w9v"
server_key: "0e8b126384155ba3eb30b7898343cb68"
server_key_iv: "dd44fb42c143d30582e3fbd45cd552a5"
server_key_version: "encryptionkey@0"
I20260807 22:41:53.320982 14103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:53.339286 14103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:53.343405 14103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:53.343639 14103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:53.344508 14103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:53.345729 14103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:53.345811 14103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:53.345876 14103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:53.345907 14103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:53.357949 14103 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:36465
I20260807 22:41:53.357967 14245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:36465 every 8 connection(s)
I20260807 22:41:53.359196 14103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:53.361950 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 14103
I20260807 22:41:53.362092 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:41:53.362473 26833 external_mini_cluster.cc:1428] Setting key 24a13849ae3f7189c11a9da3a969e142
Aug 07 22:41:53 dist-test-slave-8w9v krb5kdc[13845](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142513, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
I20260807 22:41:53.382752 13936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.361579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:33683 (local address 127.26.52.126:37403)
0807 22:41:53.361744 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:53.361749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:53.368338 (+ 6589us) server_negotiation.cc:407] Connection header received
0807 22:41:53.368407 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:53.368412 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:53.368482 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:53.368587 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:53.370653 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.371429 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.373630 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.373932 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.374021 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.377543 (+ 3522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:53.377547 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:53.377550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:53.377582 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:53.379537 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:53.380425 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:53.380430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:53.380432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:53.380537 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:53.381032 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:53.381037 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:53.381039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:53.381376 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:53.381485 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:53.382348 (+ 863us) server_negotiation.cc:299] Negotiation successful
0807 22:41:53.382521 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:41:53.383996 14248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.362050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37403 (local address 127.26.52.66:33683)
0807 22:41:53.362948 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:53.363018 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:53.364325 (+ 1307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:53.368988 (+ 4663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:53.369002 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:53.369631 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:53.370466 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.370490 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.371583 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.371587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.373454 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.373471 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.374107 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.374115 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.374354 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.375070 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:53.375098 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:53.377282 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:53.379719 (+ 2437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:53.379731 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:53.379753 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:53.380256 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:53.380673 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:53.380679 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:53.380682 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:53.380896 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:53.381569 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:53.381580 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:53.381976 (+ 396us) client_negotiation.cc:769] Sending connection context
0807 22:41:53.382265 (+ 289us) client_negotiation.cc:240] Negotiation successful
0807 22:41:53.382717 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":160,"threads_started":1}
I20260807 22:41:53.385558 14246 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37403
I20260807 22:41:53.385848 14246 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:53.386471 14246 heartbeater.cc:511] Master 127.26.52.126:37403 requested a full tablet report, sending...
I20260807 22:41:53.387753 13893 ts_manager.cc:194] Registered new tserver with Master: 0e092018418d464f83a84c1cd9e8357b (127.26.52.66:36465)
I20260807 22:41:53.388674 13893 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:33683
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:41:53.398840 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37403
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:43397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:53.514441 14251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:53.514753 14251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:53.514837 14251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:53.518996 14251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:53.519095 14251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:53.519186 14251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:41:53.524789 14251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:43397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:37403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:53.526005 14251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:53.527083 14251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:53.537230 14256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:53.537223 14259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:53.537343 14251 server_base.cc:1034] running on GCE node
W20260807 22:41:53.537223 14257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:53.537994 14251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:53.538692 14251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:53.539896 14251 hybrid_clock.cc:648] HybridClock initialized: now 1786142513539863 us; error 44 us; skew 500 ppm
Aug 07 22:41:53 dist-test-slave-8w9v krb5kdc[13845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142513, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:53.542757 14251 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:41:53.543670 14251 webserver.cc:460] Webserver started at http://127.26.52.67:40961/ using document root <none> and password file <none>
I20260807 22:41:53.544327 14251 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:53.544416 14251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:53.544652 14251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:53.546774 14251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "3300a832c24f4acb91ac26f266784897"
format_stamp: "Formatted at 2026-08-07 22:41:53 on dist-test-slave-8w9v"
server_key: "76b61750fc3009bb4b08273c06d10117"
server_key_iv: "9fb572d203fc734c34eb89deff0823c7"
server_key_version: "encryptionkey@0"
I20260807 22:41:53.547345 14251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "3300a832c24f4acb91ac26f266784897"
format_stamp: "Formatted at 2026-08-07 22:41:53 on dist-test-slave-8w9v"
server_key: "76b61750fc3009bb4b08273c06d10117"
server_key_iv: "9fb572d203fc734c34eb89deff0823c7"
server_key_version: "encryptionkey@0"
I20260807 22:41:53.551226 14251 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260807 22:41:53.553885 14266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:53.555361 14251 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:41:53.555521 14251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "3300a832c24f4acb91ac26f266784897"
format_stamp: "Formatted at 2026-08-07 22:41:53 on dist-test-slave-8w9v"
server_key: "76b61750fc3009bb4b08273c06d10117"
server_key_iv: "9fb572d203fc734c34eb89deff0823c7"
server_key_version: "encryptionkey@0"
I20260807 22:41:53.555641 14251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:53.574137 14251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:53.577397 14251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:53.577648 14251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:53.578321 14251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:53.579245 14251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:53.579319 14251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:53.579396 14251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:53.579445 14251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:53.588297 14251 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:40575
I20260807 22:41:53.588373 14383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:40575 every 8 connection(s)
I20260807 22:41:53.589285 14251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:53.596613 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 14251
I20260807 22:41:53.596798 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:41:53.597136 26833 external_mini_cluster.cc:1428] Setting key 5c9c3d7ad61a239161220d162cfb2b3d
Aug 07 22:41:53 dist-test-slave-8w9v krb5kdc[13845](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142513, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:53.603303 13936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.591216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:40027 (local address 127.26.52.126:37403)
0807 22:41:53.591354 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:53.591358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:53.592461 (+ 1103us) server_negotiation.cc:407] Connection header received
0807 22:41:53.593481 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:53.593485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:53.593548 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:53.593650 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:53.594814 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.595344 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.596649 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.596994 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.597090 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.599973 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:53.599977 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:53.599980 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:53.600011 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:53.601371 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:53.601898 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:53.601901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:53.601902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:53.601974 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:53.602302 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:53.602304 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:53.602305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:53.602492 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:53.602567 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:53.603053 (+ 486us) server_negotiation.cc:299] Negotiation successful
0807 22:41:53.603156 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:41:53.604326 14386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.591566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:37403 (local address 127.26.52.67:40027)
0807 22:41:53.592300 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:53.592344 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:53.593255 (+ 911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:53.593821 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:53.593828 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:53.594193 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:53.594667 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.594680 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.595473 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.595481 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.596516 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.596528 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.597164 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.597172 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.597368 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.598018 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:53.598043 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:53.599800 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:53.601504 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:53.601509 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:53.601522 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:53.601793 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:53.602051 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:53.602053 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:53.602055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:53.602191 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:53.602599 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:53.602604 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:53.602845 (+ 241us) client_negotiation.cc:769] Sending connection context
0807 22:41:53.603012 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 22:41:53.603283 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":119,"threads_started":1}
I20260807 22:41:53.605451 14384 heartbeater.cc:347] Connected to a master server at 127.26.52.126:37403
I20260807 22:41:53.605731 14384 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:53.606281 14384 heartbeater.cc:511] Master 127.26.52.126:37403 requested a full tablet report, sending...
I20260807 22:41:53.607339 13893 ts_manager.cc:194] Registered new tserver with Master: 3300a832c24f4acb91ac26f266784897 (127.26.52.67:40575)
I20260807 22:41:53.607966 13893 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:40027
I20260807 22:41:53.611121 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:41:53.621335 13936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.613127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.26.52.126:37403)
0807 22:41:53.613283 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:53.613288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:53.613445 (+ 157us) server_negotiation.cc:407] Connection header received
0807 22:41:53.613547 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:53.613549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:53.613589 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:53.613653 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:53.614764 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.615408 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.616270 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.616480 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.616566 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.618078 (+ 1512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:53.618081 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:53.618083 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:53.618107 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:53.619523 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:53.620010 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:53.620013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:53.620014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:53.620085 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:53.620504 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:53.620506 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:53.620507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:53.620706 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:53.620821 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:53.621050 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 22:41:53.621147 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 22:41:53.624418 13893 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:41:53.627583 13893 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:41:53.641831 14396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.635775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:36465 (local address 127.0.0.1:60488)
0807 22:41:53.636341 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:53.636392 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:53.636529 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:53.637265 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:53.637272 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:53.637293 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:53.637461 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.637469 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.638803 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.638808 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.640038 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.640049 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.641267 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.641271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.641379 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.641416 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 22:41:53.641530 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 22:41:53.641656 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":26,"thread_start_us":79,"threads_started":1}
I20260807 22:41:53.641846 14395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.635912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:34895 (local address 127.0.0.1:39958)
0807 22:41:53.636765 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:53.636780 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:53.636862 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:53.637587 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:53.637591 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:53.637612 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:53.637726 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.637733 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.639368 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.639372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.640477 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.640486 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.641539 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.641543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.641621 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.641642 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:41:53.641698 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:41:53.641755 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"mutex_wait_us":1,"thread_start_us":134,"threads_started":1}
I20260807 22:41:53.642020 14399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.636647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39958 (local address 127.26.52.65:34895)
0807 22:41:53.637120 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:53.637139 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:53.637165 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:41:53.637244 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:53.637249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:53.637425 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:53.637870 (+ 445us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:53.638055 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.639229 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.640616 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.641431 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.641543 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.641679 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:53.641739 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 22:41:53.641835 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":105,"threads_started":1}
I20260807 22:41:53.642436 14397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.635937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60488 (local address 127.26.52.66:36465)
0807 22:41:53.636444 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:53.636456 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:53.636482 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:41:53.636846 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:53.636853 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:53.637090 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:53.637628 (+ 538us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:53.637796 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.638682 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.640392 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.641136 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.641268 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.641440 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:53.642229 (+ 789us) server_negotiation.cc:299] Negotiation successful
0807 22:41:53.642321 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":128,"threads_started":1}
I20260807 22:41:53.642897 14398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.636536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:40575 (local address 127.0.0.1:32850)
0807 22:41:53.637591 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:53.637603 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:53.637676 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:53.638187 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:53.638190 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:53.638209 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:53.638284 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.638289 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.639586 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.639591 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.640714 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.640724 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.642490 (+ 1766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.642494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.642581 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.642604 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 22:41:53.642681 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:41:53.642754 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":997,"thread_start_us":89,"threads_started":1}
I20260807 22:41:53.643003 14400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.636994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32850 (local address 127.26.52.67:40575)
0807 22:41:53.637435 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:53.637448 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:53.637774 (+ 326us) server_negotiation.cc:407] Connection header received
0807 22:41:53.637856 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:53.637860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:53.638025 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:53.638183 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:53.638402 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.639461 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.640859 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.641663 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.641767 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.641888 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:53.642748 (+ 860us) server_negotiation.cc:299] Negotiation successful
0807 22:41:53.642832 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":153,"threads_started":1}
I20260807 22:41:53.645370 14172 tablet_service.cc:1467] Processing CreateTablet for tablet f32514ade2614f8ebc9397c34b488ba2 (DEFAULT_TABLE table=test-table [id=ca0f26b230f441fdb8d9ec8e2909d707]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:53.645371 14025 tablet_service.cc:1467] Processing CreateTablet for tablet f32514ade2614f8ebc9397c34b488ba2 (DEFAULT_TABLE table=test-table [id=ca0f26b230f441fdb8d9ec8e2909d707]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:53.646582 14025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f32514ade2614f8ebc9397c34b488ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:53.646582 14172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f32514ade2614f8ebc9397c34b488ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:53.646284 14315 tablet_service.cc:1467] Processing CreateTablet for tablet f32514ade2614f8ebc9397c34b488ba2 (DEFAULT_TABLE table=test-table [id=ca0f26b230f441fdb8d9ec8e2909d707]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:53.647171 14315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f32514ade2614f8ebc9397c34b488ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:53.653148 14401 tablet_bootstrap.cc:492] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: Bootstrap starting.
I20260807 22:41:53.655994 14401 tablet_bootstrap.cc:654] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:53.656569 14402 tablet_bootstrap.cc:492] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756: Bootstrap starting.
I20260807 22:41:53.657193 14401 log.cc:824] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:53.658535 14402 tablet_bootstrap.cc:654] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:53.659283 14401 tablet_bootstrap.cc:492] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: No bootstrap required, opened a new log
I20260807 22:41:53.659516 14401 ts_tablet_manager.cc:1397] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 22:41:53.659775 14403 tablet_bootstrap.cc:492] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: Bootstrap starting.
I20260807 22:41:53.662017 14403 tablet_bootstrap.cc:654] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:53.662247 14402 log.cc:824] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:53.662856 14403 log.cc:824] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:53.662832 14401 raft_consensus.cc:348] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e092018418d464f83a84c1cd9e8357b" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36465 } } peers { permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 } } peers { permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 } }
I20260807 22:41:53.663189 14401 raft_consensus.cc:374] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:53.663257 14401 raft_consensus.cc:729] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3300a832c24f4acb91ac26f266784897, State: Initialized, Role: FOLLOWER
I20260807 22:41:53.663775 14401 consensus_queue.cc:260] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e092018418d464f83a84c1cd9e8357b" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36465 } } peers { permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 } } peers { permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 } }
I20260807 22:41:53.664528 14384 heartbeater.cc:503] Master 127.26.52.126:37403 was elected leader, sending a full tablet report...
I20260807 22:41:53.664552 14402 tablet_bootstrap.cc:492] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756: No bootstrap required, opened a new log
I20260807 22:41:53.664737 14402 ts_tablet_manager.cc:1397] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 22:41:53.664845 14401 ts_tablet_manager.cc:1428] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:41:53.664901 14403 tablet_bootstrap.cc:492] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: No bootstrap required, opened a new log
I20260807 22:41:53.665102 14403 ts_tablet_manager.cc:1397] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:41:53.668534 14402 raft_consensus.cc:348] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e092018418d464f83a84c1cd9e8357b" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36465 } } peers { permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 } } peers { permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 } }
I20260807 22:41:53.668808 14402 raft_consensus.cc:374] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:53.668887 14402 raft_consensus.cc:729] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f43227baf4e841f1b7d6bc7f8efa2756, State: Initialized, Role: FOLLOWER
I20260807 22:41:53.668833 14403 raft_consensus.cc:348] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e092018418d464f83a84c1cd9e8357b" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36465 } } peers { permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 } } peers { permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 } }
I20260807 22:41:53.669169 14403 raft_consensus.cc:374] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:53.669241 14403 raft_consensus.cc:729] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e092018418d464f83a84c1cd9e8357b, State: Initialized, Role: FOLLOWER
I20260807 22:41:53.669377 14402 consensus_queue.cc:260] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e092018418d464f83a84c1cd9e8357b" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36465 } } peers { permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 } } peers { permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 } }
I20260807 22:41:53.669682 14403 consensus_queue.cc:260] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e092018418d464f83a84c1cd9e8357b" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36465 } } peers { permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 } } peers { permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 } }
I20260807 22:41:53.670328 14402 ts_tablet_manager.cc:1428] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:41:53.670341 14246 heartbeater.cc:503] Master 127.26.52.126:37403 was elected leader, sending a full tablet report...
I20260807 22:41:53.670621 14403 ts_tablet_manager.cc:1428] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 22:41:53.670674 14097 heartbeater.cc:503] Master 127.26.52.126:37403 was elected leader, sending a full tablet report...
W20260807 22:41:53.840430 14385 tablet.cc:2369] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:41:53.860559 14247 tablet.cc:2369] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:41:53.879415 14098 tablet.cc:2369] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:41:53.964273 14409 raft_consensus.cc:482] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:53.964571 14409 raft_consensus.cc:504] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e092018418d464f83a84c1cd9e8357b" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36465 } } peers { permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 } } peers { permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 } }
I20260807 22:41:53.965876 14409 leader_election.cc:288] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f43227baf4e841f1b7d6bc7f8efa2756 (127.26.52.65:34895), 3300a832c24f4acb91ac26f266784897 (127.26.52.67:40575)
I20260807 22:41:53.970148 14400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.966281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:51129 (local address 127.26.52.67:40575)
0807 22:41:53.966414 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:53.966419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:53.966701 (+ 282us) server_negotiation.cc:407] Connection header received
0807 22:41:53.966851 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:53.966854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:53.966894 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:53.966998 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:53.967356 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.967839 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.969099 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.969509 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.969607 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.969650 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:53.969936 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 22:41:53.970011 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:41:53.970170 14411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.966120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:34895 (local address 127.26.52.66:53061)
0807 22:41:53.966506 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:53.966518 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:53.966630 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:53.966963 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:53.966970 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:53.966991 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:53.967163 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.967170 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.967996 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.967999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.968938 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.968948 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.969733 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.969736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.969830 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.969848 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 22:41:53.969942 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:41:53.970011 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":82,"thread_start_us":115,"threads_started":1}
I20260807 22:41:53.970180 14399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.966302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:53061 (local address 127.26.52.65:34895)
0807 22:41:53.966452 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:53.966457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:53.966621 (+ 164us) server_negotiation.cc:407] Connection header received
0807 22:41:53.966778 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:53.966783 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:53.966852 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:53.966928 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:53.967290 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.967853 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.969068 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.969601 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.969754 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.969817 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:53.969973 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 22:41:53.970049 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:41:53.970198 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:53.966158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:40575 (local address 127.26.52.66:51129)
0807 22:41:53.966559 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:53.966593 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:53.966737 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:53.967037 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:53.967043 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:53.967064 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:53.967234 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.967244 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.967963 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.967966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.968943 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:53.968954 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:53.969638 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:53.969645 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:53.969767 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:53.969794 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 22:41:53.969893 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 22:41:53.969997 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":41,"thread_start_us":92,"threads_started":1}
I20260807 22:41:53.970953 14047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f32514ade2614f8ebc9397c34b488ba2" candidate_uuid: "0e092018418d464f83a84c1cd9e8357b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" is_pre_election: true
I20260807 22:41:53.971007 14337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f32514ade2614f8ebc9397c34b488ba2" candidate_uuid: "0e092018418d464f83a84c1cd9e8357b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3300a832c24f4acb91ac26f266784897" is_pre_election: true
I20260807 22:41:53.971362 14047 raft_consensus.cc:2454] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e092018418d464f83a84c1cd9e8357b in term 0.
I20260807 22:41:53.971362 14337 raft_consensus.cc:2454] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e092018418d464f83a84c1cd9e8357b in term 0.
I20260807 22:41:53.971921 14120 leader_election.cc:302] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e092018418d464f83a84c1cd9e8357b, f43227baf4e841f1b7d6bc7f8efa2756; no voters:
I20260807 22:41:53.972262 14409 raft_consensus.cc:2781] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:41:53.972363 14409 raft_consensus.cc:482] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:41:53.972486 14409 raft_consensus.cc:3037] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:53.973624 14409 raft_consensus.cc:504] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e092018418d464f83a84c1cd9e8357b" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36465 } } peers { permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 } } peers { permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 } }
I20260807 22:41:53.974000 14409 leader_election.cc:288] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [CANDIDATE]: Term 1 election: Requested vote from peers f43227baf4e841f1b7d6bc7f8efa2756 (127.26.52.65:34895), 3300a832c24f4acb91ac26f266784897 (127.26.52.67:40575)
I20260807 22:41:53.974499 14047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f32514ade2614f8ebc9397c34b488ba2" candidate_uuid: "0e092018418d464f83a84c1cd9e8357b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43227baf4e841f1b7d6bc7f8efa2756"
I20260807 22:41:53.974570 14337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f32514ade2614f8ebc9397c34b488ba2" candidate_uuid: "0e092018418d464f83a84c1cd9e8357b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3300a832c24f4acb91ac26f266784897"
I20260807 22:41:53.974654 14047 raft_consensus.cc:3037] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:53.974690 14337 raft_consensus.cc:3037] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:53.976207 14047 raft_consensus.cc:2454] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e092018418d464f83a84c1cd9e8357b in term 1.
I20260807 22:41:53.976217 14337 raft_consensus.cc:2454] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e092018418d464f83a84c1cd9e8357b in term 1.
I20260807 22:41:53.976542 14120 leader_election.cc:302] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e092018418d464f83a84c1cd9e8357b, f43227baf4e841f1b7d6bc7f8efa2756; no voters:
I20260807 22:41:53.976831 14409 raft_consensus.cc:2781] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:53.977047 14409 raft_consensus.cc:686] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 1 LEADER]: Becoming Leader. State: Replica: 0e092018418d464f83a84c1cd9e8357b, State: Running, Role: LEADER
I20260807 22:41:53.977425 14409 consensus_queue.cc:237] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e092018418d464f83a84c1cd9e8357b" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36465 } } peers { permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 } } peers { permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 } }
I20260807 22:41:53.981063 13891 catalog_manager.cc:5495] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e092018418d464f83a84c1cd9e8357b (127.26.52.66). New cstate: current_term: 1 leader_uuid: "0e092018418d464f83a84c1cd9e8357b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e092018418d464f83a84c1cd9e8357b" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 36465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260807 22:41:54.018947 14397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:54.015357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60492 (local address 127.26.52.66:36465)
0807 22:41:54.015495 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:54.015499 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:54.015513 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:41:54.015585 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:54.015587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:54.015641 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:54.015730 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:41:54.015979 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.016525 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.017434 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.017653 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.017760 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:54.018042 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:41:54.018485 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:41:54.018603 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:54.018770 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 22:41:54.018819 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:41:54.025305 14047 raft_consensus.cc:1261] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756 [term 1 FOLLOWER]: Refusing update from remote peer 0e092018418d464f83a84c1cd9e8357b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:54.025308 14337 raft_consensus.cc:1261] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897 [term 1 FOLLOWER]: Refusing update from remote peer 0e092018418d464f83a84c1cd9e8357b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:54.026051 14412 consensus_queue.cc:1035] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3300a832c24f4acb91ac26f266784897" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:54.026266 14409 consensus_queue.cc:1035] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f43227baf4e841f1b7d6bc7f8efa2756" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:54.033869 14415 mvcc.cc:205] Tried to move back new op lower bound from 7316039737439264768 to 7316039737254641664. Current Snapshot: MvccSnapshot[applied={T|T < 7316039737439264768}]
I20260807 22:41:54.034957 14417 mvcc.cc:205] Tried to move back new op lower bound from 7316039737439264768 to 7316039737254641664. Current Snapshot: MvccSnapshot[applied={T|T < 7316039737439264768}]
I20260807 22:41:54.035243 14416 mvcc.cc:205] Tried to move back new op lower bound from 7316039737439264768 to 7316039737254641664. Current Snapshot: MvccSnapshot[applied={T|T < 7316039737439264768}]
I20260807 22:41:54.046159 13893 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:54.046368 13893 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:54.049008 13893 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 796878a192f64363af9540fc40a18d0e: Sending DeleteTablet for 3 replicas of tablet f32514ade2614f8ebc9397c34b488ba2
I20260807 22:41:54.050064 14025 tablet_service.cc:1514] Processing DeleteTablet for tablet f32514ade2614f8ebc9397c34b488ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:54 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:39958
I20260807 22:41:54.050163 14315 tablet_service.cc:1514] Processing DeleteTablet for tablet f32514ade2614f8ebc9397c34b488ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:54 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:32850
I20260807 22:41:54.050734 14424 tablet_replica.cc:330] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756: stopping tablet replica
I20260807 22:41:54.050724 14172 tablet_service.cc:1514] Processing DeleteTablet for tablet f32514ade2614f8ebc9397c34b488ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:54 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:60488
I20260807 22:41:54.051162 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 13960
I20260807 22:41:54.051227 14425 tablet_replica.cc:330] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: stopping tablet replica
I20260807 22:41:54.051366 14424 raft_consensus.cc:2229] T f32514ade2614f8ebc9397c34b488ba2 P f43227baf4e841f1b7d6bc7f8efa2756 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:54.051529 14425 raft_consensus.cc:2229] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:54.051864 14425 raft_consensus.cc:2258] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:54.052009 14426 tablet_replica.cc:330] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: stopping tablet replica
I20260807 22:41:54.052371 14426 raft_consensus.cc:2229] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:41:54.052917 14426 raft_consensus.cc:2258] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:54.055087 14426 ts_tablet_manager.cc:1905] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:54.057216 14425 ts_tablet_manager.cc:1905] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:54.058687 14426 ts_tablet_manager.cc:1918] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:54.058936 14426 log.cc:1196] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/f32514ade2614f8ebc9397c34b488ba2
I20260807 22:41:54.059432 14426 ts_tablet_manager.cc:1939] T f32514ade2614f8ebc9397c34b488ba2 P 0e092018418d464f83a84c1cd9e8357b: Deleting consensus metadata
I20260807 22:41:54.060422 14425 ts_tablet_manager.cc:1918] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:54.060541 14425 log.cc:1196] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/f32514ade2614f8ebc9397c34b488ba2
I20260807 22:41:54.060875 14425 ts_tablet_manager.cc:1939] T f32514ade2614f8ebc9397c34b488ba2 P 3300a832c24f4acb91ac26f266784897: Deleting consensus metadata
I20260807 22:41:54.061383 13877 catalog_manager.cc:4841] TS 0e092018418d464f83a84c1cd9e8357b (127.26.52.66:36465): tablet f32514ade2614f8ebc9397c34b488ba2 (table test-table [id=ca0f26b230f441fdb8d9ec8e2909d707]) successfully deleted
I20260807 22:41:54.062184 13877 catalog_manager.cc:4841] TS 3300a832c24f4acb91ac26f266784897 (127.26.52.67:40575): tablet f32514ade2614f8ebc9397c34b488ba2 (table test-table [id=ca0f26b230f441fdb8d9ec8e2909d707]) successfully deleted
W20260807 22:41:54.064332 13876 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:34895 (error 108)
I20260807 22:41:54.065284 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 14103
I20260807 22:41:54.065512 14398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:54.065177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:34895 (local address 127.0.0.1:39970)
0807 22:41:54.065343 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:54.065421 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:34895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260807 22:41:54.067005 13876 catalog_manager.cc:4584] TS f43227baf4e841f1b7d6bc7f8efa2756 (127.26.52.65:34895): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f32514ade2614f8ebc9397c34b488ba2: Network error: Client connection negotiation failed: client connection to 127.26.52.65:34895: connect: Connection refused (error 111)
I20260807 22:41:54.073424 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 14251
I20260807 22:41:54.081794 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 13858
2026-08-07T22:41:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2627 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T22:41:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:41:54Z Disabled control of system clock
I20260807 22:41:54.117024 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:41165
--webserver_interface=127.26.52.126
--webserver_port=0
--builtin_ntp_servers=127.26.52.84:46637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:41165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:41:54.231813 14431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:54.232101 14431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:54.232218 14431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:54.236321 14431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:54.236393 14431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:54.236409 14431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:54.236428 14431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:54.236443 14431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:54.241387 14431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:41165
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:41165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:54.242477 14431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:54.243834 14431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:54.252482 14438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:54.252564 14431 server_base.cc:1034] running on GCE node
W20260807 22:41:54.252514 14437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:54.252482 14440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:54.253433 14431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:54.254563 14431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:54.255723 14431 hybrid_clock.cc:648] HybridClock initialized: now 1786142514255705 us; error 32 us; skew 500 ppm
I20260807 22:41:54.262538 14431 webserver.cc:460] Webserver started at http://127.26.52.126:42581/ using document root <none> and password file <none>
I20260807 22:41:54.263211 14431 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:54.263280 14431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:54.263517 14431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:54.265756 14431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "d4b43f0efdca4d90a7fa285675d69ee9"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "59313e942ab24b90fcd191fa5ce2e5b4"
server_key_iv: "b3bfc5c6d4a4947914b5c5126513e881"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.266359 14431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "d4b43f0efdca4d90a7fa285675d69ee9"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "59313e942ab24b90fcd191fa5ce2e5b4"
server_key_iv: "b3bfc5c6d4a4947914b5c5126513e881"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.270445 14431 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:41:54.273857 14447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:54.275207 14431 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:41:54.275362 14431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "d4b43f0efdca4d90a7fa285675d69ee9"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "59313e942ab24b90fcd191fa5ce2e5b4"
server_key_iv: "b3bfc5c6d4a4947914b5c5126513e881"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.275488 14431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:54.299650 14431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:54.300521 14431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:54.300743 14431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:54.308337 14431 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:41165
I20260807 22:41:54.308368 14504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:41165 every 8 connection(s)
I20260807 22:41:54.309427 14431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:54.312829 14505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:54.314025 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 14431
I20260807 22:41:54.314127 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:41:54.314451 26833 external_mini_cluster.cc:1428] Setting key 731b14be009861bad6fbbbd076c8cf9e
I20260807 22:41:54.319530 14505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9: Bootstrap starting.
I20260807 22:41:54.322202 14505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:54.323025 14505 log.cc:824] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:54.324194 14509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:54.316022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54030 (local address 127.26.52.126:41165)
0807 22:41:54.316774 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:54.316790 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:54.316826 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:41:54.317517 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:54.317535 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:54.317939 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:54.318291 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:54.318753 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.319736 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.320695 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.321171 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.321366 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:54.322288 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:54.322293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:54.322306 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:54.322743 (+ 437us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:54.322801 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:54.322822 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:54.322931 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:54.323090 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 22:41:54.323398 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":170,"threads_started":1}
I20260807 22:41:54.325479 14505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9: No bootstrap required, opened a new log
I20260807 22:41:54.329375 14505 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4b43f0efdca4d90a7fa285675d69ee9" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41165 } }
I20260807 22:41:54.329656 14505 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:54.329738 14505 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b43f0efdca4d90a7fa285675d69ee9, State: Initialized, Role: FOLLOWER
I20260807 22:41:54.330233 14505 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4b43f0efdca4d90a7fa285675d69ee9" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41165 } }
I20260807 22:41:54.330400 14505 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:54.330493 14505 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:54.330608 14505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:54.331686 14505 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4b43f0efdca4d90a7fa285675d69ee9" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41165 } }
I20260807 22:41:54.332064 14505 leader_election.cc:302] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4b43f0efdca4d90a7fa285675d69ee9; no voters:
I20260807 22:41:54.332506 14505 leader_election.cc:288] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:41:54.332623 14512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:54.332852 14512 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [term 1 LEADER]: Becoming Leader. State: Replica: d4b43f0efdca4d90a7fa285675d69ee9, State: Running, Role: LEADER
I20260807 22:41:54.333201 14512 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4b43f0efdca4d90a7fa285675d69ee9" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41165 } }
I20260807 22:41:54.333868 14505 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:54.334972 14514 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4b43f0efdca4d90a7fa285675d69ee9. Latest consensus state: current_term: 1 leader_uuid: "d4b43f0efdca4d90a7fa285675d69ee9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4b43f0efdca4d90a7fa285675d69ee9" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41165 } } }
I20260807 22:41:54.335137 14514 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:54.335435 14513 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4b43f0efdca4d90a7fa285675d69ee9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4b43f0efdca4d90a7fa285675d69ee9" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 41165 } } }
I20260807 22:41:54.335541 14513 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:54.335548 14523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:54.338804 14523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:54.344327 14523 catalog_manager.cc:1347] Generated new cluster ID: 4a96ed00926c468284df503ff9e603fe
I20260807 22:41:54.344412 14523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:54.363308 14523 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:41:54.364342 14523 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:54.369413 14523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9: Generated new TSK 0
I20260807 22:41:54.370229 14523 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:41:54.382088 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41165
--builtin_ntp_servers=127.26.52.84:46637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:41:54.498907 14536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:54.499171 14536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:54.499210 14536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:54.503733 14536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:54.503793 14536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:54.503850 14536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:41:54.508813 14536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:54.509922 14536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:54.511283 14536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:54.521011 14542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:54.521027 14543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:54.521050 14545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:54.521317 14536 server_base.cc:1034] running on GCE node
I20260807 22:41:54.521804 14536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:54.522497 14536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:54.523686 14536 hybrid_clock.cc:648] HybridClock initialized: now 1786142514523671 us; error 32 us; skew 500 ppm
I20260807 22:41:54.525673 14536 webserver.cc:460] Webserver started at http://127.26.52.65:41111/ using document root <none> and password file <none>
I20260807 22:41:54.526281 14536 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:54.526373 14536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:54.526633 14536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:54.528826 14536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "aa81151904ae493ca4ed18ae49bb3b1e"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "7e48019245c60d591feee67f1f35b4ae"
server_key_iv: "a1c52bbb1e3c8038c9cc35fb94d8979d"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.529392 14536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "aa81151904ae493ca4ed18ae49bb3b1e"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "7e48019245c60d591feee67f1f35b4ae"
server_key_iv: "a1c52bbb1e3c8038c9cc35fb94d8979d"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.533245 14536 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:41:54.535907 14551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:54.537201 14536 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:41:54.537333 14536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "aa81151904ae493ca4ed18ae49bb3b1e"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "7e48019245c60d591feee67f1f35b4ae"
server_key_iv: "a1c52bbb1e3c8038c9cc35fb94d8979d"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.537449 14536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:54.557014 14536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:54.557763 14536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:54.557967 14536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:54.558602 14536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:54.559607 14536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:54.559679 14536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:54.559754 14536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:54.559794 14536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:54.568648 14536 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:43937
I20260807 22:41:54.568682 14674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:43937 every 8 connection(s)
I20260807 22:41:54.569571 14536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:54.578356 14509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:54.571456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:44847 (local address 127.26.52.126:41165)
0807 22:41:54.571600 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:54.571604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:54.572659 (+ 1055us) server_negotiation.cc:407] Connection header received
0807 22:41:54.574011 (+ 1352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:54.574014 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:54.574066 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:54.574133 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:54.574980 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.575517 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.576668 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.576877 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.576955 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:54.577942 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:54.577946 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:54.577948 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:54.577960 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:54.577978 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:54.577986 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:54.578042 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:54.578179 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 22:41:54.578235 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:41:54.579259 14677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:54.571831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41165 (local address 127.26.52.65:44847)
0807 22:41:54.572511 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:54.572551 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:54.573809 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:54.574291 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:54.574297 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:54.574375 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:54.574863 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:54.574875 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.575621 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.575623 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:54.576565 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:54.576575 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.577004 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.577006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:54.577140 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:54.577702 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:54.577704 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:54.577743 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:54.577804 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:54.578054 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:54.578061 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:54.578065 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:41:54.578163 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 22:41:54.578376 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":114,"threads_started":1}
I20260807 22:41:54.579772 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 14536
I20260807 22:41:54.579934 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:41:54.580307 26833 external_mini_cluster.cc:1428] Setting key 54622bb86fec277335c4cc55351f9e84
I20260807 22:41:54.580631 14675 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41165
I20260807 22:41:54.580861 14675 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:54.581496 14675 heartbeater.cc:511] Master 127.26.52.126:41165 requested a full tablet report, sending...
I20260807 22:41:54.582329 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41165
--builtin_ntp_servers=127.26.52.84:46637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:41:54.583155 14467 ts_manager.cc:194] Registered new tserver with Master: aa81151904ae493ca4ed18ae49bb3b1e (127.26.52.65:43937)
I20260807 22:41:54.584589 14467 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.65:44847
W20260807 22:41:54.697561 14678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:54.697854 14678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:54.697964 14678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:54.702322 14678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:54.702387 14678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:54.702483 14678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:41:54.707351 14678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:54.708617 14678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:54.710160 14678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:54.720245 14684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:54.720265 14683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:54.720487 14686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:54.720407 14678 server_base.cc:1034] running on GCE node
I20260807 22:41:54.721004 14678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:54.721681 14678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:54.722846 14678 hybrid_clock.cc:648] HybridClock initialized: now 1786142514722824 us; error 35 us; skew 500 ppm
I20260807 22:41:54.724771 14678 webserver.cc:460] Webserver started at http://127.26.52.66:41641/ using document root <none> and password file <none>
I20260807 22:41:54.725338 14678 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:54.725399 14678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:54.725577 14678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:54.727655 14678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "d059f91c280b4b74b39c158353166347"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "0bf749af6514291709f4f848705c4216"
server_key_iv: "bb91a96464427fd48f3a5b72b942fefe"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.728267 14678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "d059f91c280b4b74b39c158353166347"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "0bf749af6514291709f4f848705c4216"
server_key_iv: "bb91a96464427fd48f3a5b72b942fefe"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.731971 14678 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:41:54.734525 14693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:54.735809 14678 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:41:54.735983 14678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "d059f91c280b4b74b39c158353166347"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "0bf749af6514291709f4f848705c4216"
server_key_iv: "bb91a96464427fd48f3a5b72b942fefe"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.736083 14678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:54.759565 14678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:54.760396 14678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:54.760599 14678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:54.761329 14678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:54.762363 14678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:54.762413 14678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:54.762492 14678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:54.762528 14678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:54.771543 14678 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:39731
I20260807 22:41:54.771569 14811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:39731 every 8 connection(s)
I20260807 22:41:54.772616 14678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:54.780450 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 14678
I20260807 22:41:54.780609 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:41:54.780936 26833 external_mini_cluster.cc:1428] Setting key 21dd63854f3e033d23ded2625a76683c
I20260807 22:41:54.782452 14509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:54.774591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:50391 (local address 127.26.52.126:41165)
0807 22:41:54.774741 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:54.774745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:54.775822 (+ 1077us) server_negotiation.cc:407] Connection header received
0807 22:41:54.777328 (+ 1506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:54.777330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:54.777382 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:54.777453 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:54.778368 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.778961 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.780301 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.780602 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.780711 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:54.781945 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:54.781948 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:54.781951 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:54.781962 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:54.781982 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:54.781990 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:54.782050 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:54.782247 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 22:41:54.782315 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:41:54.783160 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41165
--builtin_ntp_servers=127.26.52.84:46637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:41:54.783672 14814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:54.775008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41165 (local address 127.26.52.66:50391)
0807 22:41:54.775668 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:54.775709 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:54.777103 (+ 1394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:54.777634 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:54.777640 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:54.777725 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:54.778221 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:54.778234 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.779075 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.779077 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:54.780165 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:54.780180 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.780761 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.780765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:54.780954 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:54.781635 (+ 681us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:54.781636 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:54.781706 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:54.781788 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:54.782076 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:54.782086 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:54.782092 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:41:54.782231 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 22:41:54.782572 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":111,"threads_started":1}
I20260807 22:41:54.784935 14812 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41165
I20260807 22:41:54.785189 14812 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:54.785729 14812 heartbeater.cc:511] Master 127.26.52.126:41165 requested a full tablet report, sending...
I20260807 22:41:54.786773 14467 ts_manager.cc:194] Registered new tserver with Master: d059f91c280b4b74b39c158353166347 (127.26.52.66:39731)
I20260807 22:41:54.787351 14467 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.66:50391
W20260807 22:41:54.901324 14815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:54.901630 14815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:54.901700 14815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:54.905788 14815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:54.905882 14815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:54.905977 14815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:41:54.911167 14815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:41165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:54.912369 14815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:54.913856 14815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:54.924082 14820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:54.924177 14815 server_base.cc:1034] running on GCE node
W20260807 22:41:54.924058 14822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:54.924084 14824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:54.924801 14815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:54.925516 14815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:54.926716 14815 hybrid_clock.cc:648] HybridClock initialized: now 1786142514926691 us; error 37 us; skew 500 ppm
I20260807 22:41:54.928697 14815 webserver.cc:460] Webserver started at http://127.26.52.67:34351/ using document root <none> and password file <none>
I20260807 22:41:54.929317 14815 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:54.929410 14815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:54.929649 14815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:54.931782 14815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "6fa8a71e9e424bc9901fe4474760a890"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "1fc64526fed34ee0e50518993716e8d2"
server_key_iv: "1f047c38c1938d5d6e2dbad43c6ca6cc"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.932381 14815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "6fa8a71e9e424bc9901fe4474760a890"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "1fc64526fed34ee0e50518993716e8d2"
server_key_iv: "1f047c38c1938d5d6e2dbad43c6ca6cc"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.936524 14815 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:41:54.939340 14831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:54.940864 14815 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:41:54.940980 14815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "6fa8a71e9e424bc9901fe4474760a890"
format_stamp: "Formatted at 2026-08-07 22:41:54 on dist-test-slave-8w9v"
server_key: "1fc64526fed34ee0e50518993716e8d2"
server_key_iv: "1f047c38c1938d5d6e2dbad43c6ca6cc"
server_key_version: "encryptionkey@0"
I20260807 22:41:54.941076 14815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:54.963737 14815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:54.964547 14815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:54.964712 14815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:54.965304 14815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:54.966276 14815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:54.966326 14815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:54.966368 14815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:54.966387 14815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:54.975059 14815 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:38821
I20260807 22:41:54.975139 14948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:38821 every 8 connection(s)
I20260807 22:41:54.976083 14815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:54.981042 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 14815
I20260807 22:41:54.981174 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:41:54.981449 26833 external_mini_cluster.cc:1428] Setting key 35ec6f0cd4f964cacf2f32b31d3cc2f8
I20260807 22:41:54.986069 14509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:54.977960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:57647 (local address 127.26.52.126:41165)
0807 22:41:54.978110 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:54.978114 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:54.979335 (+ 1221us) server_negotiation.cc:407] Connection header received
0807 22:41:54.980932 (+ 1597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:54.980936 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:54.981007 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:54.981120 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:54.982225 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.982776 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.983968 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.984292 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.984415 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:54.985518 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:54.985522 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:54.985525 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:54.985540 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:54.985566 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:54.985576 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:54.985653 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:54.985839 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 22:41:54.985908 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:41:54.986941 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:54.978386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:41165 (local address 127.26.52.67:57647)
0807 22:41:54.979167 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:54.979212 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:54.980691 (+ 1479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:54.981303 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:54.981310 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:54.981395 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:54.982052 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:54.982078 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.982918 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.982921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:54.983831 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:54.983842 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.984457 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.984462 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:54.984643 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:54.985239 (+ 596us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:54.985240 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:54.985280 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:54.985346 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:54.985669 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:54.985681 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:54.985693 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 22:41:54.985838 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 22:41:54.986126 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":135,"threads_started":1}
I20260807 22:41:54.988036 14949 heartbeater.cc:347] Connected to a master server at 127.26.52.126:41165
I20260807 22:41:54.988318 14949 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:54.988848 14949 heartbeater.cc:511] Master 127.26.52.126:41165 requested a full tablet report, sending...
I20260807 22:41:54.989853 14467 ts_manager.cc:194] Registered new tserver with Master: 6fa8a71e9e424bc9901fe4474760a890 (127.26.52.67:38821)
I20260807 22:41:54.990442 14467 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.67:57647
I20260807 22:41:54.995290 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:41:55.001327 14509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:54.997353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54042 (local address 127.26.52.126:41165)
0807 22:41:54.997495 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:54.997500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:54.997685 (+ 185us) server_negotiation.cc:407] Connection header received
0807 22:41:54.997832 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:54.997835 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:54.997881 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:54.997973 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:54.998258 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.998768 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.999612 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:54.999840 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:54.999962 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.000886 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:55.000890 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:55.000893 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:55.000913 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:55.000935 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:55.000944 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:55.001051 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:55.001174 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 22:41:55.001211 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:41:55.004452 14467 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54042:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:41:55.007656 14467 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:41:55.023087 14960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.016767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:39731 (local address 127.0.0.1:43022)
0807 22:41:55.017228 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:55.017292 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:55.017439 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:55.018306 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:55.018313 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:55.018338 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:55.018512 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:55.018520 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.020218 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.020222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:55.021389 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:55.021399 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.022499 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.022502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:55.022610 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.022649 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 22:41:55.022781 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 22:41:55.022906 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":206,"thread_start_us":102,"threads_started":1}
I20260807 22:41:55.023283 14964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.017529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:43937 (local address 127.0.0.1:50126)
0807 22:41:55.018434 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:55.018446 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:55.018517 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:55.019453 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:55.019456 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:55.019474 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:55.019553 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:55.019558 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.020760 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.020763 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:55.021837 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:55.021846 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.022899 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.022902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:55.022986 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.023010 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:41:55.023064 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 22:41:55.023134 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"thread_start_us":93,"threads_started":1}
I20260807 22:41:55.023106 14961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.016843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:38821 (local address 127.0.0.1:46296)
0807 22:41:55.017517 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:55.017529 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:55.017623 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:55.018780 (+ 1157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:55.018782 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:55.018794 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:55.018866 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:55.018870 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.020199 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.020203 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:55.021595 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:55.021606 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.022777 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.022780 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:55.022859 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.022879 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 22:41:55.022956 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:41:55.023013 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":109,"threads_started":1}
I20260807 22:41:55.023768 14967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.018108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50126 (local address 127.26.52.65:43937)
0807 22:41:55.019096 (+ 988us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:55.019104 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:55.019122 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:41:55.019181 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:55.019184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:55.019307 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:55.019478 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:55.019682 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.020626 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.021956 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.022757 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.023234 (+ 477us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.023421 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:55.023484 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 22:41:55.023591 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":897,"thread_start_us":116,"threads_started":1}
I20260807 22:41:55.023134 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.016905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.26.52.66:39731)
0807 22:41:55.017745 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:55.017756 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:55.017779 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:41:55.017868 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:55.017875 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:55.018099 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:55.018670 (+ 571us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:55.018817 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.020032 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.021526 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.022359 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.022495 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.022698 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:55.022821 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 22:41:55.022949 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":734,"thread_start_us":108,"threads_started":1}
I20260807 22:41:55.024621 14965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.018035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46296 (local address 127.26.52.67:38821)
0807 22:41:55.018358 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:55.018371 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:55.018393 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:41:55.018469 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:55.018476 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:55.018655 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:55.018797 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:55.018945 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.020032 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.021740 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.022365 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.022492 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.022697 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:55.023604 (+ 907us) server_negotiation.cc:299] Negotiation successful
0807 22:41:55.023709 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":114,"threads_started":1}
I20260807 22:41:55.026652 14603 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5b65b574c94408ac07fbef7c0aa765 (DEFAULT_TABLE table=test-table [id=aca88247f6d746b190627826cbfb4516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:55.026741 14742 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5b65b574c94408ac07fbef7c0aa765 (DEFAULT_TABLE table=test-table [id=aca88247f6d746b190627826cbfb4516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:55.027122 14880 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5b65b574c94408ac07fbef7c0aa765 (DEFAULT_TABLE table=test-table [id=aca88247f6d746b190627826cbfb4516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:55.027878 14603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5b65b574c94408ac07fbef7c0aa765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:55.027989 14742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5b65b574c94408ac07fbef7c0aa765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:55.028154 14880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5b65b574c94408ac07fbef7c0aa765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:55.034328 14968 tablet_bootstrap.cc:492] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e: Bootstrap starting.
I20260807 22:41:55.036113 14969 tablet_bootstrap.cc:492] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: Bootstrap starting.
I20260807 22:41:55.036737 14970 tablet_bootstrap.cc:492] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: Bootstrap starting.
I20260807 22:41:55.037693 14968 tablet_bootstrap.cc:654] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:55.038204 14969 tablet_bootstrap.cc:654] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:55.038645 14968 log.cc:824] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:55.038882 14970 tablet_bootstrap.cc:654] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:55.038930 14969 log.cc:824] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:55.039768 14970 log.cc:824] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:55.041123 14968 tablet_bootstrap.cc:492] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e: No bootstrap required, opened a new log
I20260807 22:41:55.041326 14969 tablet_bootstrap.cc:492] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: No bootstrap required, opened a new log
I20260807 22:41:55.041359 14968 ts_tablet_manager.cc:1397] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 22:41:55.041499 14969 ts_tablet_manager.cc:1397] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 22:41:55.041905 14970 tablet_bootstrap.cc:492] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: No bootstrap required, opened a new log
I20260807 22:41:55.042117 14970 ts_tablet_manager.cc:1397] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260807 22:41:55.045703 14970 raft_consensus.cc:348] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d059f91c280b4b74b39c158353166347" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39731 } } peers { permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 } } peers { permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 } }
I20260807 22:41:55.046017 14970 raft_consensus.cc:374] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:55.046084 14970 raft_consensus.cc:729] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fa8a71e9e424bc9901fe4474760a890, State: Initialized, Role: FOLLOWER
I20260807 22:41:55.046012 14969 raft_consensus.cc:348] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d059f91c280b4b74b39c158353166347" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39731 } } peers { permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 } } peers { permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 } }
I20260807 22:41:55.045979 14968 raft_consensus.cc:348] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d059f91c280b4b74b39c158353166347" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39731 } } peers { permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 } } peers { permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 } }
I20260807 22:41:55.046241 14969 raft_consensus.cc:374] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:55.046252 14968 raft_consensus.cc:374] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:55.046306 14968 raft_consensus.cc:729] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa81151904ae493ca4ed18ae49bb3b1e, State: Initialized, Role: FOLLOWER
I20260807 22:41:55.046372 14969 raft_consensus.cc:729] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d059f91c280b4b74b39c158353166347, State: Initialized, Role: FOLLOWER
I20260807 22:41:55.046588 14970 consensus_queue.cc:260] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d059f91c280b4b74b39c158353166347" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39731 } } peers { permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 } } peers { permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 } }
I20260807 22:41:55.046792 14968 consensus_queue.cc:260] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d059f91c280b4b74b39c158353166347" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39731 } } peers { permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 } } peers { permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 } }
I20260807 22:41:55.046792 14969 consensus_queue.cc:260] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d059f91c280b4b74b39c158353166347" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39731 } } peers { permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 } } peers { permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 } }
I20260807 22:41:55.047555 14812 heartbeater.cc:503] Master 127.26.52.126:41165 was elected leader, sending a full tablet report...
I20260807 22:41:55.047830 14969 ts_tablet_manager.cc:1428] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 22:41:55.047825 14675 heartbeater.cc:503] Master 127.26.52.126:41165 was elected leader, sending a full tablet report...
I20260807 22:41:55.047832 14968 ts_tablet_manager.cc:1428] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:41:55.048450 14949 heartbeater.cc:503] Master 127.26.52.126:41165 was elected leader, sending a full tablet report...
I20260807 22:41:55.048885 14970 ts_tablet_manager.cc:1428] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
W20260807 22:41:55.070851 14676 tablet.cc:2369] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:41:55.227160 14950 tablet.cc:2369] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:41:55.243566 14975 raft_consensus.cc:482] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:55.243839 14975 raft_consensus.cc:504] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d059f91c280b4b74b39c158353166347" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39731 } } peers { permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 } } peers { permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 } }
I20260807 22:41:55.245227 14975 leader_election.cc:288] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fa8a71e9e424bc9901fe4474760a890 (127.26.52.67:38821), aa81151904ae493ca4ed18ae49bb3b1e (127.26.52.65:43937)
I20260807 22:41:55.249375 14814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.245522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:38821 (local address 127.26.52.66:38705)
0807 22:41:55.245686 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:55.245706 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:55.245865 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:55.246169 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:55.246174 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:55.246200 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:55.246349 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:55.246360 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.247200 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.247204 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:55.248089 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:55.248099 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.248960 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.248964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:55.249062 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.249095 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 22:41:55.249171 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:41:55.249246 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 22:41:55.249471 14965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.245591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:38705 (local address 127.26.52.67:38821)
0807 22:41:55.245771 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:55.245778 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:55.245797 (+ 19us) server_negotiation.cc:407] Connection header received
0807 22:41:55.245991 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:55.245994 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:55.246061 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:55.246141 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:55.246462 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.247096 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.248279 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.248830 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.248935 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.248977 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:55.249204 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 22:41:55.249312 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 22:41:55.249682 14977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.245840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:43937 (local address 127.26.52.66:36147)
0807 22:41:55.246189 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:55.246203 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:55.246290 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:55.246555 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:55.246558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:55.246575 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:55.246699 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:55.246705 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.247504 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.247507 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:55.248442 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:55.248454 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.249222 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.249227 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:55.249331 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.249356 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:41:55.249446 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:41:55.249523 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":113,"threads_started":1}
I20260807 22:41:55.249723 14967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.245996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:36147 (local address 127.26.52.65:43937)
0807 22:41:55.246140 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:55.246145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:55.246281 (+ 136us) server_negotiation.cc:407] Connection header received
0807 22:41:55.246403 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:55.246406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:55.246464 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:55.246526 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:55.246809 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.247373 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.248586 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.249063 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.249187 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.249229 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:55.249483 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 22:41:55.249567 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:41:55.250154 14902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5b65b574c94408ac07fbef7c0aa765" candidate_uuid: "d059f91c280b4b74b39c158353166347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa8a71e9e424bc9901fe4474760a890" is_pre_election: true
I20260807 22:41:55.250507 14902 raft_consensus.cc:2454] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d059f91c280b4b74b39c158353166347 in term 0.
I20260807 22:41:55.250602 14626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5b65b574c94408ac07fbef7c0aa765" candidate_uuid: "d059f91c280b4b74b39c158353166347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" is_pre_election: true
I20260807 22:41:55.250890 14626 raft_consensus.cc:2454] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d059f91c280b4b74b39c158353166347 in term 0.
I20260807 22:41:55.251078 14695 leader_election.cc:302] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fa8a71e9e424bc9901fe4474760a890, d059f91c280b4b74b39c158353166347; no voters:
I20260807 22:41:55.251379 14975 raft_consensus.cc:2781] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:41:55.251464 14975 raft_consensus.cc:482] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:41:55.251519 14975 raft_consensus.cc:3037] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:55.252704 14975 raft_consensus.cc:504] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d059f91c280b4b74b39c158353166347" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39731 } } peers { permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 } } peers { permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 } }
I20260807 22:41:55.253075 14975 leader_election.cc:288] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [CANDIDATE]: Term 1 election: Requested vote from peers 6fa8a71e9e424bc9901fe4474760a890 (127.26.52.67:38821), aa81151904ae493ca4ed18ae49bb3b1e (127.26.52.65:43937)
I20260807 22:41:55.253547 14902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5b65b574c94408ac07fbef7c0aa765" candidate_uuid: "d059f91c280b4b74b39c158353166347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa8a71e9e424bc9901fe4474760a890"
I20260807 22:41:55.253628 14626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5b65b574c94408ac07fbef7c0aa765" candidate_uuid: "d059f91c280b4b74b39c158353166347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa81151904ae493ca4ed18ae49bb3b1e"
I20260807 22:41:55.253695 14902 raft_consensus.cc:3037] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:55.253814 14626 raft_consensus.cc:3037] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:55.254874 14626 raft_consensus.cc:2454] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d059f91c280b4b74b39c158353166347 in term 1.
I20260807 22:41:55.254884 14902 raft_consensus.cc:2454] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d059f91c280b4b74b39c158353166347 in term 1.
I20260807 22:41:55.255211 14695 leader_election.cc:302] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fa8a71e9e424bc9901fe4474760a890, d059f91c280b4b74b39c158353166347; no voters:
I20260807 22:41:55.255388 14975 raft_consensus.cc:2781] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:55.255656 14975 raft_consensus.cc:686] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 1 LEADER]: Becoming Leader. State: Replica: d059f91c280b4b74b39c158353166347, State: Running, Role: LEADER
I20260807 22:41:55.256021 14975 consensus_queue.cc:237] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d059f91c280b4b74b39c158353166347" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39731 } } peers { permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 } } peers { permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 } }
I20260807 22:41:55.259541 14465 catalog_manager.cc:5495] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 reported cstate change: term changed from 0 to 1, leader changed from <none> to d059f91c280b4b74b39c158353166347 (127.26.52.66). New cstate: current_term: 1 leader_uuid: "d059f91c280b4b74b39c158353166347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d059f91c280b4b74b39c158353166347" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 39731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 } health_report { overall_health: UNKNOWN } } }
W20260807 22:41:55.273840 14813 tablet.cc:2369] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:41:55.324995 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.321267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43030 (local address 127.26.52.66:39731)
0807 22:41:55.321411 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:55.321415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:55.321466 (+ 51us) server_negotiation.cc:407] Connection header received
0807 22:41:55.321576 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:55.321580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:55.321658 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:55.321778 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:41:55.322069 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.322571 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.323507 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:55.323708 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:55.323782 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:55.324083 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:41:55.324507 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:41:55.324614 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:55.324752 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 22:41:55.324787 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:41:55.330932 14626 raft_consensus.cc:1261] T 4f5b65b574c94408ac07fbef7c0aa765 P aa81151904ae493ca4ed18ae49bb3b1e [term 1 FOLLOWER]: Refusing update from remote peer d059f91c280b4b74b39c158353166347: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:55.330940 14902 raft_consensus.cc:1261] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890 [term 1 FOLLOWER]: Refusing update from remote peer d059f91c280b4b74b39c158353166347: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:55.331665 14978 consensus_queue.cc:1035] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa81151904ae493ca4ed18ae49bb3b1e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 43937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:55.331892 14975 consensus_queue.cc:1035] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fa8a71e9e424bc9901fe4474760a890" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 38821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:55.339599 14982 mvcc.cc:205] Tried to move back new op lower bound from 7316039742788173824 to 7316039742491619328. Current Snapshot: MvccSnapshot[applied={T|T < 7316039742788173824}]
I20260807 22:41:55.340075 14983 mvcc.cc:205] Tried to move back new op lower bound from 7316039742788173824 to 7316039742491619328. Current Snapshot: MvccSnapshot[applied={T|T < 7316039742788173824}]
I20260807 22:41:55.348352 14466 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:55.348541 14466 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:55.350867 14466 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d4b43f0efdca4d90a7fa285675d69ee9: Sending DeleteTablet for 3 replicas of tablet 4f5b65b574c94408ac07fbef7c0aa765
I20260807 22:41:55.351629 14742 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f5b65b574c94408ac07fbef7c0aa765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:55 UTC) from {username='slave'} at 127.0.0.1:43022
I20260807 22:41:55.351683 14603 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f5b65b574c94408ac07fbef7c0aa765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:55 UTC) from {username='slave'} at 127.0.0.1:50126
I20260807 22:41:55.352180 14991 tablet_replica.cc:330] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: stopping tablet replica
I20260807 22:41:55.352375 14880 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f5b65b574c94408ac07fbef7c0aa765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:55 UTC) from {username='slave'} at 127.0.0.1:46296
I20260807 22:41:55.352591 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 14536
I20260807 22:41:55.353942 14994 tablet_replica.cc:330] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: stopping tablet replica
I20260807 22:41:55.354132 14991 raft_consensus.cc:2229] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:41:55.354241 14994 raft_consensus.cc:2229] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:55.354565 14994 raft_consensus.cc:2258] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:55.354694 14991 raft_consensus.cc:2258] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:55.356266 14991 ts_tablet_manager.cc:1905] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:55.358731 14991 ts_tablet_manager.cc:1918] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:55.358860 14991 log.cc:1196] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/4f5b65b574c94408ac07fbef7c0aa765
I20260807 22:41:55.359207 14991 ts_tablet_manager.cc:1939] T 4f5b65b574c94408ac07fbef7c0aa765 P d059f91c280b4b74b39c158353166347: Deleting consensus metadata
I20260807 22:41:55.360857 14994 ts_tablet_manager.cc:1905] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:55.361196 14448 catalog_manager.cc:4841] TS d059f91c280b4b74b39c158353166347 (127.26.52.66:39731): tablet 4f5b65b574c94408ac07fbef7c0aa765 (table test-table [id=aca88247f6d746b190627826cbfb4516]) successfully deleted
I20260807 22:41:55.363258 14994 ts_tablet_manager.cc:1918] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:55.363372 14994 log.cc:1196] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/4f5b65b574c94408ac07fbef7c0aa765
I20260807 22:41:55.363648 14994 ts_tablet_manager.cc:1939] T 4f5b65b574c94408ac07fbef7c0aa765 P 6fa8a71e9e424bc9901fe4474760a890: Deleting consensus metadata
I20260807 22:41:55.365104 14449 catalog_manager.cc:4841] TS 6fa8a71e9e424bc9901fe4474760a890 (127.26.52.67:38821): tablet 4f5b65b574c94408ac07fbef7c0aa765 (table test-table [id=aca88247f6d746b190627826cbfb4516]) successfully deleted
W20260807 22:41:55.365899 14449 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:43937 (error 108)
I20260807 22:41:55.366763 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 14678
I20260807 22:41:55.366943 14961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:55.366620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:43937 (local address 127.0.0.1:50142)
0807 22:41:55.366745 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:55.366828 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:43937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 22:41:55.367805 14449 catalog_manager.cc:4584] TS aa81151904ae493ca4ed18ae49bb3b1e (127.26.52.65:43937): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4f5b65b574c94408ac07fbef7c0aa765: Network error: Client connection negotiation failed: client connection to 127.26.52.65:43937: connect: Connection refused (error 111)
I20260807 22:41:55.373767 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 14815
I20260807 22:41:55.382648 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 14431
2026-08-07T22:41:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1299 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:41:55 dist-test-slave-8w9v krb5kdc[14998](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:41:55 dist-test-slave-8w9v krb5kdc[14998](info): set up 2 sockets
Aug 07 22:41:55 dist-test-slave-8w9v krb5kdc[14998](info): commencing operation
krb5kdc: starting...
W20260807 22:41:56.470526 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:41:56 dist-test-slave-8w9v krb5kdc[14998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:41:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:41:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:41:56.599603 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:39351
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:40999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:39351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:56.718701 15011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:56.719002 15011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:56.719044 15011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:56.723166 15011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:56.723232 15011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:56.723253 15011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:56.723270 15011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:56.723331 15011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:56.728928 15011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:40999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:39351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:39351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:56.730091 15011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:56.731171 15011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:56.740105 15019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:56.740114 15016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:56.740289 15011 server_base.cc:1034] running on GCE node
W20260807 22:41:56.740108 15017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:56.741133 15011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:56.742254 15011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:56.743439 15011 hybrid_clock.cc:648] HybridClock initialized: now 1786142516743412 us; error 42 us; skew 500 ppm
Aug 07 22:41:56 dist-test-slave-8w9v krb5kdc[14998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142516, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:56.746330 15011 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:41:56.747289 15011 webserver.cc:460] Webserver started at http://127.26.52.126:42871/ using document root <none> and password file <none>
I20260807 22:41:56.747957 15011 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:56.748193 15011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:56.748463 15011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:56.751001 15011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "ada8139d98cb47fc904c922791210dc2"
format_stamp: "Formatted at 2026-08-07 22:41:56 on dist-test-slave-8w9v"
server_key: "80193bc2e291e9c4139c9c39af5369a8"
server_key_iv: "303b0cc76f2ed8fad5386df3e4ab2fe8"
server_key_version: "encryptionkey@0"
I20260807 22:41:56.751582 15011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "ada8139d98cb47fc904c922791210dc2"
format_stamp: "Formatted at 2026-08-07 22:41:56 on dist-test-slave-8w9v"
server_key: "80193bc2e291e9c4139c9c39af5369a8"
server_key_iv: "303b0cc76f2ed8fad5386df3e4ab2fe8"
server_key_version: "encryptionkey@0"
I20260807 22:41:56.755373 15011 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 22:41:56.757936 15026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:56.759231 15011 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:41:56.759390 15011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "ada8139d98cb47fc904c922791210dc2"
format_stamp: "Formatted at 2026-08-07 22:41:56 on dist-test-slave-8w9v"
server_key: "80193bc2e291e9c4139c9c39af5369a8"
server_key_iv: "303b0cc76f2ed8fad5386df3e4ab2fe8"
server_key_version: "encryptionkey@0"
I20260807 22:41:56.759517 15011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:56.785713 15011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:56.789143 15011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:56.789376 15011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:56.796844 15011 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:39351
I20260807 22:41:56.796837 15079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:39351 every 8 connection(s)
I20260807 22:41:56.797905 15011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:56.800930 15080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:56.806748 15080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2: Bootstrap starting.
I20260807 22:41:56.807313 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 15011
I20260807 22:41:56.807458 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:41:56.807749 26833 external_mini_cluster.cc:1428] Setting key aa3311e8c8bbc3ee39b6b61385794382
I20260807 22:41:56.809587 15080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:56.810340 15080 log.cc:824] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:56.812736 15080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2: No bootstrap required, opened a new log
Aug 07 22:41:56 dist-test-slave-8w9v krb5kdc[14998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:56.817649 15080 raft_consensus.cc:348] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada8139d98cb47fc904c922791210dc2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39351 } }
I20260807 22:41:56.817914 15080 raft_consensus.cc:374] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:56.817999 15080 raft_consensus.cc:729] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ada8139d98cb47fc904c922791210dc2, State: Initialized, Role: FOLLOWER
I20260807 22:41:56.818524 15080 consensus_queue.cc:260] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada8139d98cb47fc904c922791210dc2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39351 } }
I20260807 22:41:56.818725 15080 raft_consensus.cc:388] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:56.818804 15080 raft_consensus.cc:482] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:56.818917 15080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:56.820271 15080 raft_consensus.cc:504] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada8139d98cb47fc904c922791210dc2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39351 } }
I20260807 22:41:56.820626 15080 leader_election.cc:302] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ada8139d98cb47fc904c922791210dc2; no voters:
I20260807 22:41:56.821022 15080 leader_election.cc:288] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:41:56.821132 15086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:56.821401 15086 raft_consensus.cc:686] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [term 1 LEADER]: Becoming Leader. State: Replica: ada8139d98cb47fc904c922791210dc2, State: Running, Role: LEADER
I20260807 22:41:56.821724 15086 consensus_queue.cc:237] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada8139d98cb47fc904c922791210dc2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39351 } }
I20260807 22:41:56.822494 15080 sys_catalog.cc:564] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:56.823470 15088 sys_catalog.cc:455] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ada8139d98cb47fc904c922791210dc2. Latest consensus state: current_term: 1 leader_uuid: "ada8139d98cb47fc904c922791210dc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada8139d98cb47fc904c922791210dc2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39351 } } }
I20260807 22:41:56.823606 15088 sys_catalog.cc:458] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:56.824015 15096 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:56.823968 15087 sys_catalog.cc:455] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ada8139d98cb47fc904c922791210dc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada8139d98cb47fc904c922791210dc2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 39351 } } }
I20260807 22:41:56.824060 15087 sys_catalog.cc:458] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:56.824354 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:56.809170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55406 (local address 127.26.52.126:39351)
0807 22:41:56.809607 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:56.809623 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:56.809658 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:41:56.810346 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:56.810363 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:56.810761 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:56.811135 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:56.812054 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:56.813134 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:56.814299 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:56.814794 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:56.814920 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:56.817947 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:56.817954 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:56.817975 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:56.818011 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:56.820225 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:56.820727 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:56.820733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:56.820740 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:56.820861 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:56.821188 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:56.821193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:56.821194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:56.821728 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:56.821931 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:56.822863 (+ 932us) server_negotiation.cc:299] Negotiation successful
0807 22:41:56.823176 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":158,"threads_started":1}
I20260807 22:41:56.827251 15096 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:56.832450 15096 catalog_manager.cc:1347] Generated new cluster ID: 0d988f371e884e7bb2d737feaae49d35
I20260807 22:41:56.832520 15096 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:56.873545 15096 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:41:56.874776 15096 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:56.884810 15096 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2: Generated new TSK 0
I20260807 22:41:56.885581 15096 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.52.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
Entry for principal kudu/127.26.52.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab.
I20260807 22:41:56.919414 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39351
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:40999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:57.055106 15110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:57.055383 15110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:57.055459 15110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:57.060146 15110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:57.060210 15110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:57.060308 15110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:41:57.065812 15110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:40999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.65.keytab
--principal=kudu/127.26.52.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:57.067051 15110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:57.068070 15110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:57.078260 15118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:57.078260 15115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:57.078284 15116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:57.078316 15110 server_base.cc:1034] running on GCE node
I20260807 22:41:57.078966 15110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:57.079649 15110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:57.080859 15110 hybrid_clock.cc:648] HybridClock initialized: now 1786142517080841 us; error 37 us; skew 500 ppm
Aug 07 22:41:57 dist-test-slave-8w9v krb5kdc[14998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:57.083693 15110 init.cc:377] Logged in from keytab as kudu/127.26.52.65@KRBTEST.COM (short username kudu)
I20260807 22:41:57.084663 15110 webserver.cc:460] Webserver started at http://127.26.52.65:34197/ using document root <none> and password file <none>
I20260807 22:41:57.085212 15110 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:57.085273 15110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:57.085454 15110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:57.087486 15110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "b5bddd5710004880bb0ed45520b8b211"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "c793bcbbb9a9bca1efd8272e7f29bb72"
server_key_iv: "bfdd7ff0ee0988ff0b3f7aeaabc96211"
server_key_version: "encryptionkey@0"
I20260807 22:41:57.088008 15110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "b5bddd5710004880bb0ed45520b8b211"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "c793bcbbb9a9bca1efd8272e7f29bb72"
server_key_iv: "bfdd7ff0ee0988ff0b3f7aeaabc96211"
server_key_version: "encryptionkey@0"
I20260807 22:41:57.091771 15110 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:41:57.094259 15125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:57.095474 15110 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:41:57.095611 15110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "b5bddd5710004880bb0ed45520b8b211"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "c793bcbbb9a9bca1efd8272e7f29bb72"
server_key_iv: "bfdd7ff0ee0988ff0b3f7aeaabc96211"
server_key_version: "encryptionkey@0"
I20260807 22:41:57.095721 15110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:57.109879 15110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:57.112957 15110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:57.113170 15110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:57.113806 15110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:57.114679 15110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:57.114725 15110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:57.114792 15110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:57.114822 15110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:57.123931 15110 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:32839
I20260807 22:41:57.123974 15243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:32839 every 8 connection(s)
I20260807 22:41:57.124939 15110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:57.127454 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 15110
I20260807 22:41:57.127592 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:41:57.127951 26833 external_mini_cluster.cc:1428] Setting key edb996919383968bc5f20d0455039158
Aug 07 22:41:57 dist-test-slave-8w9v krb5kdc[14998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.65@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.66@KRBTEST.COM; defaulting to no policy
I20260807 22:41:57.139365 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.126712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:52959 (local address 127.26.52.126:39351)
0807 22:41:57.126857 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.126861 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.127792 (+ 931us) server_negotiation.cc:407] Connection header received
0807 22:41:57.129397 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.129400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.129450 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.129525 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:57.130651 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.131200 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.132482 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.132892 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.133032 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.135447 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:57.135453 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:57.135458 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:57.135495 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:57.137159 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:57.137688 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:57.137691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:57.137692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:57.137766 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:57.138098 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:57.138103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:57.138105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:57.138329 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:57.138437 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.139032 (+ 595us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.139182 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:41:57.140254 15246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.127098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:39351 (local address 127.26.52.65:52959)
0807 22:41:57.127619 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.127678 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:57.129171 (+ 1493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:57.129691 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:57.129697 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:57.130043 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:57.130511 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.130523 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.131348 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.131355 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.132355 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.132365 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.133056 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.133059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.133197 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.133790 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:57.133806 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:57.135275 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:57.137285 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:57.137291 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:57.137312 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:57.137573 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:57.137857 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:57.137861 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:57.137863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:57.138002 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:57.138448 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:57.138457 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:57.138756 (+ 299us) client_negotiation.cc:769] Sending connection context
0807 22:41:57.138988 (+ 232us) client_negotiation.cc:240] Negotiation successful
0807 22:41:57.139362 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":101,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.66@KRBTEST.COM" created.
I20260807 22:41:57.141515 15244 heartbeater.cc:347] Connected to a master server at 127.26.52.126:39351
I20260807 22:41:57.141757 15244 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:57.142270 15244 heartbeater.cc:511] Master 127.26.52.126:39351 requested a full tablet report, sending...
I20260807 22:41:57.143752 15044 ts_manager.cc:194] Registered new tserver with Master: b5bddd5710004880bb0ed45520b8b211 (127.26.52.65:32839)
I20260807 22:41:57.144938 15044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.65@KRBTEST.COM'} at 127.26.52.65:52959
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
Entry for principal kudu/127.26.52.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab.
I20260807 22:41:57.158856 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39351
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:40999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:57.273656 15249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:57.273927 15249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:57.273972 15249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:57.278165 15249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:57.278234 15249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:57.278326 15249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:41:57.284694 15249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:40999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.66.keytab
--principal=kudu/127.26.52.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:57.285903 15249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:57.286948 15249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:57.296656 15259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:57.296656 15257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:57.296690 15256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:57.296708 15249 server_base.cc:1034] running on GCE node
I20260807 22:41:57.297376 15249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:57.298008 15249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:57.299163 15249 hybrid_clock.cc:648] HybridClock initialized: now 1786142517299147 us; error 28 us; skew 500 ppm
Aug 07 22:41:57 dist-test-slave-8w9v krb5kdc[14998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:57.301980 15249 init.cc:377] Logged in from keytab as kudu/127.26.52.66@KRBTEST.COM (short username kudu)
I20260807 22:41:57.302839 15249 webserver.cc:460] Webserver started at http://127.26.52.66:44943/ using document root <none> and password file <none>
I20260807 22:41:57.303416 15249 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:57.303504 15249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:57.303735 15249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:57.305850 15249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "b540e57a5e124cc7a8c96872d54caf59"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "f2f9d407d04a188f6e03b925a7fff23c"
server_key_iv: "06a94ca7d2f168bd00fc346380ab6fd0"
server_key_version: "encryptionkey@0"
I20260807 22:41:57.306463 15249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "b540e57a5e124cc7a8c96872d54caf59"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "f2f9d407d04a188f6e03b925a7fff23c"
server_key_iv: "06a94ca7d2f168bd00fc346380ab6fd0"
server_key_version: "encryptionkey@0"
I20260807 22:41:57.310293 15249 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260807 22:41:57.312755 15266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:57.313990 15249 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:41:57.314127 15249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "b540e57a5e124cc7a8c96872d54caf59"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "f2f9d407d04a188f6e03b925a7fff23c"
server_key_iv: "06a94ca7d2f168bd00fc346380ab6fd0"
server_key_version: "encryptionkey@0"
I20260807 22:41:57.314241 15249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:57.340101 15249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:57.343554 15249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:57.343767 15249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:57.344475 15249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:57.345345 15249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:57.345410 15249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:57.345472 15249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:57.345511 15249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:57.354759 15249 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:42959
I20260807 22:41:57.354791 15385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:42959 every 8 connection(s)
I20260807 22:41:57.355703 15249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:57.356666 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 15249
I20260807 22:41:57.356783 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:41:57.357159 26833 external_mini_cluster.cc:1428] Setting key d8d3fe2dfa6032a54429930f8dd5d816
Aug 07 22:41:57 dist-test-slave-8w9v krb5kdc[14998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.66@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.67@KRBTEST.COM; defaulting to no policy
I20260807 22:41:57.371093 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.357882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:43243 (local address 127.26.52.126:39351)
0807 22:41:57.358064 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.358068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.358968 (+ 900us) server_negotiation.cc:407] Connection header received
0807 22:41:57.360312 (+ 1344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.360316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.360373 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.360453 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:57.361672 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.362223 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.363429 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.363886 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.364034 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.367060 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:57.367064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:57.367069 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:57.367110 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:57.368887 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:57.369441 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:57.369447 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:57.369451 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:57.369537 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:57.369977 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:57.369980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:57.369981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:57.370173 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:57.370260 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.370840 (+ 580us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.370963 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.67@KRBTEST.COM" created.
I20260807 22:41:57.372112 15388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.358324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:39351 (local address 127.26.52.66:43243)
0807 22:41:57.358814 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.358862 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:57.360074 (+ 1212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:57.360624 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:57.360630 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:57.361000 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:57.361515 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.361529 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.362369 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.362373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.363284 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.363294 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.364098 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.364101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.364336 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.365019 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:57.365035 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:57.366859 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:57.369011 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:57.369017 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:57.369030 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:57.369290 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:57.369664 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:57.369667 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:57.369668 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:57.369826 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:57.370270 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:57.370275 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:57.370565 (+ 290us) client_negotiation.cc:769] Sending connection context
0807 22:41:57.370811 (+ 246us) client_negotiation.cc:240] Negotiation successful
0807 22:41:57.371121 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":144,"threads_started":1}
I20260807 22:41:57.373471 15386 heartbeater.cc:347] Connected to a master server at 127.26.52.126:39351
I20260807 22:41:57.373737 15386 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:57.374318 15386 heartbeater.cc:511] Master 127.26.52.126:39351 requested a full tablet report, sending...
I20260807 22:41:57.375473 15044 ts_manager.cc:194] Registered new tserver with Master: b540e57a5e124cc7a8c96872d54caf59 (127.26.52.66:42959)
I20260807 22:41:57.376415 15044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.66@KRBTEST.COM'} at 127.26.52.66:43243
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
Entry for principal kudu/127.26.52.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab.
I20260807 22:41:57.389391 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39351
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:40999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:57.504470 15391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:57.504760 15391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:57.504804 15391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:57.509009 15391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:57.509083 15391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:57.509143 15391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:41:57.514546 15391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:40999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.67.keytab
--principal=kudu/127.26.52.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:39351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:57.515645 15391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:57.516794 15391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:57.527137 15396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:57.527137 15397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:57.527573 15391 server_base.cc:1034] running on GCE node
W20260807 22:41:57.527594 15399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:57.528038 15391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:57.528724 15391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:57.529919 15391 hybrid_clock.cc:648] HybridClock initialized: now 1786142517529889 us; error 44 us; skew 500 ppm
Aug 07 22:41:57 dist-test-slave-8w9v krb5kdc[14998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:57.532756 15391 init.cc:377] Logged in from keytab as kudu/127.26.52.67@KRBTEST.COM (short username kudu)
I20260807 22:41:57.533644 15391 webserver.cc:460] Webserver started at http://127.26.52.67:39241/ using document root <none> and password file <none>
I20260807 22:41:57.534237 15391 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:57.534325 15391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:57.534570 15391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:57.536787 15391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "7298b8b79e934ae1a56a46771453f0d0"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "26ec23e9dc3ecd85399bacc28c571ae4"
server_key_iv: "25ea57fc6a0216bedae377acdc907143"
server_key_version: "encryptionkey@0"
I20260807 22:41:57.537434 15391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "7298b8b79e934ae1a56a46771453f0d0"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "26ec23e9dc3ecd85399bacc28c571ae4"
server_key_iv: "25ea57fc6a0216bedae377acdc907143"
server_key_version: "encryptionkey@0"
I20260807 22:41:57.541307 15391 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:41:57.543680 15406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:57.544914 15391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:41:57.545051 15391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "7298b8b79e934ae1a56a46771453f0d0"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "26ec23e9dc3ecd85399bacc28c571ae4"
server_key_iv: "25ea57fc6a0216bedae377acdc907143"
server_key_version: "encryptionkey@0"
I20260807 22:41:57.545161 15391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:57.564693 15391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:57.568106 15391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:57.568346 15391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:57.568984 15391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:57.569876 15391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:57.569945 15391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:57.570022 15391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:57.570061 15391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:57.578828 15391 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:35535
I20260807 22:41:57.578884 15530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:35535 every 8 connection(s)
I20260807 22:41:57.579834 15391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:57.587100 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 15391
I20260807 22:41:57.587260 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:41:57.587556 26833 external_mini_cluster.cc:1428] Setting key 0cc609c3f614e7af13b186e8a67d30ce
Aug 07 22:41:57 dist-test-slave-8w9v krb5kdc[14998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.67@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:41:57.594156 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.581796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:35157 (local address 127.26.52.126:39351)
0807 22:41:57.581939 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.581943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.582769 (+ 826us) server_negotiation.cc:407] Connection header received
0807 22:41:57.584105 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.584108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.584199 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.584300 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:57.585528 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.586081 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.587277 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.587516 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.587628 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.590695 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:57.590699 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:57.590701 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:57.590727 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:57.591976 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:57.592556 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:57.592559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:57.592560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:57.592637 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:57.592988 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:57.592993 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:57.592994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:57.593191 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:57.593302 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.593896 (+ 594us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.594026 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:41:57.595094 15533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.582174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:39351 (local address 127.26.52.67:35157)
0807 22:41:57.582616 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.582661 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:57.583873 (+ 1212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:57.584501 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:57.584509 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:57.584878 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:57.585371 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.585385 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.586216 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.586219 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.587144 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.587154 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.587689 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.587693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.587922 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.588660 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:57.588681 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:57.590522 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:57.592099 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:57.592106 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:57.592150 (+ 44us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:57.592438 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:57.592730 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:57.592733 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:57.592735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:57.592889 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:57.593303 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:57.593311 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:57.593610 (+ 299us) client_negotiation.cc:769] Sending connection context
0807 22:41:57.593837 (+ 227us) client_negotiation.cc:240] Negotiation successful
0807 22:41:57.594162 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":107,"threads_started":1}
I20260807 22:41:57.596472 15531 heartbeater.cc:347] Connected to a master server at 127.26.52.126:39351
I20260807 22:41:57.596745 15531 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:57.597309 15531 heartbeater.cc:511] Master 127.26.52.126:39351 requested a full tablet report, sending...
I20260807 22:41:57.598461 15044 ts_manager.cc:194] Registered new tserver with Master: 7298b8b79e934ae1a56a46771453f0d0 (127.26.52.67:35535)
I20260807 22:41:57.599061 15044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.52.67@KRBTEST.COM'} at 127.26.52.67:35157
I20260807 22:41:57.601723 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:41:57.611836 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.603863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55410 (local address 127.26.52.126:39351)
0807 22:41:57.603993 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.604002 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.604257 (+ 255us) server_negotiation.cc:407] Connection header received
0807 22:41:57.604368 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.604370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.604412 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.604482 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:57.605399 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.605915 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.606915 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.607135 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.607213 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.608749 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:57.608752 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:57.608754 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:57.608779 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:57.610248 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:57.610654 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:57.610656 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:57.610658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:57.610732 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:57.611044 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:57.611046 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:57.611047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:57.611263 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:57.611366 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.611612 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.611712 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:41:57.614959 15044 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:41:57.618130 15044 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:41:57.632942 15542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.627631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:32839 (local address 127.0.0.1:60836)
0807 22:41:57.628267 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.628280 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:57.628348 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:57.628831 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:57.628834 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:57.628851 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:57.628966 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.628974 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.630072 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.630078 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.631251 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.631262 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.632587 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.632594 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.632682 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.632702 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 22:41:57.632764 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 22:41:57.632816 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":96,"threads_started":1}
I20260807 22:41:57.632992 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.626984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58044 (local address 127.26.52.67:35535)
0807 22:41:57.627382 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.627403 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.627957 (+ 554us) server_negotiation.cc:407] Connection header received
0807 22:41:57.628192 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.628198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.628431 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.628616 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:57.628932 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.630106 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.631500 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.632249 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.632355 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.632507 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.632690 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.632792 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":203,"threads_started":1}
I20260807 22:41:57.632946 15543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.626870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:35535 (local address 127.0.0.1:58044)
0807 22:41:57.627804 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.627854 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:57.628014 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:57.628602 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:57.628608 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:57.628633 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:57.628781 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.628788 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.630265 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.630268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.631364 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.631373 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.632369 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.632373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.632482 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.632520 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 22:41:57.632638 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 22:41:57.632774 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":116,"threads_started":1}
I20260807 22:41:57.633440 15547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.628075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60836 (local address 127.26.52.65:32839)
0807 22:41:57.628370 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.628386 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.628409 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:41:57.628481 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.628486 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.628674 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.628822 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:57.629067 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.629948 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.631394 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.632264 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.632374 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.632524 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.633174 (+ 650us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.633278 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":119,"threads_started":1}
I20260807 22:41:57.633556 15545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.626943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:42959 (local address 127.0.0.1:47436)
0807 22:41:57.627958 (+ 1015us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.627973 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:57.628067 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:57.629266 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:57.629269 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:57.629288 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:57.629363 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.629369 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.630720 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.630723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.631805 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.631815 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.632937 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.632941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.633247 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.633272 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 22:41:57.633325 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:41:57.633393 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":936,"thread_start_us":94,"threads_started":1}
I20260807 22:41:57.634176 15546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.627609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47436 (local address 127.26.52.66:42959)
0807 22:41:57.628834 (+ 1225us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.628850 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.628874 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:41:57.628950 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.628955 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.629126 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.629278 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:57.629482 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.630567 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.631936 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.632791 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.633735 (+ 944us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.633875 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.633922 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.634005 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":141,"threads_started":1}
I20260807 22:41:57.636317 15176 tablet_service.cc:1467] Processing CreateTablet for tablet 93901144c62847e0ad2a79b82da1f6be (DEFAULT_TABLE table=test-table [id=c7111b2f7c9542bf8e6edd3e4629a40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:57.636446 15316 tablet_service.cc:1467] Processing CreateTablet for tablet 93901144c62847e0ad2a79b82da1f6be (DEFAULT_TABLE table=test-table [id=c7111b2f7c9542bf8e6edd3e4629a40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:57.637377 15316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93901144c62847e0ad2a79b82da1f6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:57.637398 15176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93901144c62847e0ad2a79b82da1f6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:57.638881 15459 tablet_service.cc:1467] Processing CreateTablet for tablet 93901144c62847e0ad2a79b82da1f6be (DEFAULT_TABLE table=test-table [id=c7111b2f7c9542bf8e6edd3e4629a40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:57.640005 15459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93901144c62847e0ad2a79b82da1f6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:57.643915 15548 tablet_bootstrap.cc:492] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: Bootstrap starting.
I20260807 22:41:57.645267 15550 tablet_bootstrap.cc:492] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211: Bootstrap starting.
I20260807 22:41:57.646196 15548 tablet_bootstrap.cc:654] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:57.647089 15551 tablet_bootstrap.cc:492] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: Bootstrap starting.
I20260807 22:41:57.647387 15550 tablet_bootstrap.cc:654] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:57.647444 15548 log.cc:824] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:57.648264 15550 log.cc:824] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:57.649267 15551 tablet_bootstrap.cc:654] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:57.650363 15548 tablet_bootstrap.cc:492] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: No bootstrap required, opened a new log
I20260807 22:41:57.650439 15551 log.cc:824] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:57.650565 15548 ts_tablet_manager.cc:1397] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 22:41:57.652375 15551 tablet_bootstrap.cc:492] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: No bootstrap required, opened a new log
I20260807 22:41:57.652568 15551 ts_tablet_manager.cc:1397] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:41:57.653479 15550 tablet_bootstrap.cc:492] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211: No bootstrap required, opened a new log
I20260807 22:41:57.653674 15550 ts_tablet_manager.cc:1397] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.004s
I20260807 22:41:57.654546 15548 raft_consensus.cc:348] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.654835 15548 raft_consensus.cc:374] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:57.654896 15548 raft_consensus.cc:729] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b540e57a5e124cc7a8c96872d54caf59, State: Initialized, Role: FOLLOWER
I20260807 22:41:57.655375 15548 consensus_queue.cc:260] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.656471 15548 ts_tablet_manager.cc:1428] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:41:57.656350 15551 raft_consensus.cc:348] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.656632 15551 raft_consensus.cc:374] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:57.656687 15551 raft_consensus.cc:729] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7298b8b79e934ae1a56a46771453f0d0, State: Initialized, Role: FOLLOWER
I20260807 22:41:57.656869 15386 heartbeater.cc:503] Master 127.26.52.126:39351 was elected leader, sending a full tablet report...
I20260807 22:41:57.657094 15551 consensus_queue.cc:260] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.657650 15531 heartbeater.cc:503] Master 127.26.52.126:39351 was elected leader, sending a full tablet report...
I20260807 22:41:57.657763 15550 raft_consensus.cc:348] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.657979 15551 ts_tablet_manager.cc:1428] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:41:57.658022 15550 raft_consensus.cc:374] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:57.658083 15550 raft_consensus.cc:729] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5bddd5710004880bb0ed45520b8b211, State: Initialized, Role: FOLLOWER
I20260807 22:41:57.658524 15550 consensus_queue.cc:260] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.659170 15244 heartbeater.cc:503] Master 127.26.52.126:39351 was elected leader, sending a full tablet report...
I20260807 22:41:57.659489 15550 ts_tablet_manager.cc:1428] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 22:41:57.708711 15555 raft_consensus.cc:482] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:57.708966 15555 raft_consensus.cc:504] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.710333 15555 leader_election.cc:288] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7298b8b79e934ae1a56a46771453f0d0 (127.26.52.67:35535), b5bddd5710004880bb0ed45520b8b211 (127.26.52.65:32839)
I20260807 22:41:57.710492 15556 raft_consensus.cc:482] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:57.710714 15556 raft_consensus.cc:504] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.712168 15556 leader_election.cc:288] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b540e57a5e124cc7a8c96872d54caf59 (127.26.52.66:42959), b5bddd5710004880bb0ed45520b8b211 (127.26.52.65:32839)
I20260807 22:41:57.715894 15388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.710639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:32839 (local address 127.26.52.66:49479)
0807 22:41:57.710856 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.710873 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:57.710993 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:57.711390 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:57.711397 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:57.711425 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:57.711584 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.711591 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.713038 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.713042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.714402 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.714421 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.715386 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.715390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.715574 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.715596 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:41:57.715662 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 22:41:57.715731 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":109}
I20260807 22:41:57.715898 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.710818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:56667 (local address 127.26.52.67:35535)
0807 22:41:57.710954 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.710959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.711576 (+ 617us) server_negotiation.cc:407] Connection header received
0807 22:41:57.711779 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.711783 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.711831 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.711912 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:57.712232 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.712941 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.714514 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.715197 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.715293 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.715339 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.715703 (+ 364us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.715772 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":48}
I20260807 22:41:57.716313 15547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.710782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:49479 (local address 127.26.52.65:32839)
0807 22:41:57.710907 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.710914 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.710930 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:41:57.711140 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.711143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.711210 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.711292 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:57.712037 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.712889 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.714554 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.715159 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.715273 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.715327 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.716093 (+ 766us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.716197 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:41:57.716516 15558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.710639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:35535 (local address 127.26.52.66:56667)
0807 22:41:57.711449 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.711470 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:57.711618 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:57.711931 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:57.711934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:57.711951 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:57.712078 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.712085 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.713071 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.713075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.714379 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.714389 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.715396 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.715400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.715554 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.715583 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 22:41:57.716272 (+ 689us) client_negotiation.cc:240] Negotiation successful
0807 22:41:57.716348 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"mutex_wait_us":404,"thread_start_us":163,"threads_started":1}
I20260807 22:41:57.716984 15196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93901144c62847e0ad2a79b82da1f6be" candidate_uuid: "b540e57a5e124cc7a8c96872d54caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bddd5710004880bb0ed45520b8b211" is_pre_election: true
I20260807 22:41:57.717079 15480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93901144c62847e0ad2a79b82da1f6be" candidate_uuid: "b540e57a5e124cc7a8c96872d54caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7298b8b79e934ae1a56a46771453f0d0" is_pre_election: true
I20260807 22:41:57.717228 15533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.712320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:42959 (local address 127.26.52.67:59381)
0807 22:41:57.712648 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.712665 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:57.712750 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:57.713580 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:57.713583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:57.713602 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:57.713698 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.713704 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.714614 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.714620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.715778 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.715788 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.716770 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.716774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.716936 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.716958 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 22:41:57.717047 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 22:41:57.717119 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":32}
I20260807 22:41:57.717295 15480 raft_consensus.cc:2454] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b540e57a5e124cc7a8c96872d54caf59 in term 0.
I20260807 22:41:57.717353 15196 raft_consensus.cc:2454] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b540e57a5e124cc7a8c96872d54caf59 in term 0.
I20260807 22:41:57.717681 15546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.712441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:59381 (local address 127.26.52.66:42959)
0807 22:41:57.712545 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.712550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.712836 (+ 286us) server_negotiation.cc:407] Connection header received
0807 22:41:57.712882 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.712885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.712927 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.713000 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:57.713825 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.714496 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.715918 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.716529 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.716641 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.716698 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.717489 (+ 791us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.717558 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":42}
I20260807 22:41:57.717824 15268 leader_election.cc:302] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7298b8b79e934ae1a56a46771453f0d0, b540e57a5e124cc7a8c96872d54caf59; no voters:
I20260807 22:41:57.718207 15337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93901144c62847e0ad2a79b82da1f6be" candidate_uuid: "7298b8b79e934ae1a56a46771453f0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b540e57a5e124cc7a8c96872d54caf59" is_pre_election: true
I20260807 22:41:57.718343 15555 raft_consensus.cc:2781] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:41:57.718504 15337 raft_consensus.cc:2454] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7298b8b79e934ae1a56a46771453f0d0 in term 0.
I20260807 22:41:57.718634 15555 raft_consensus.cc:482] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:41:57.718716 15555 raft_consensus.cc:3037] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:57.718991 15407 leader_election.cc:302] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7298b8b79e934ae1a56a46771453f0d0, b540e57a5e124cc7a8c96872d54caf59; no voters:
I20260807 22:41:57.718997 15559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.712581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:32839 (local address 127.26.52.67:38947)
0807 22:41:57.712965 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.712980 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:57.713054 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:57.713960 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:57.713963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:57.713981 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:57.714090 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.714096 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.715136 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.715142 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.717004 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:57.717013 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.718537 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.718542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:57.718640 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.718666 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:41:57.718742 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:41:57.718819 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":107,"thread_start_us":113,"threads_started":1}
I20260807 22:41:57.719266 15560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.713308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:38947 (local address 127.26.52.65:32839)
0807 22:41:57.713666 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.713674 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.713687 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:41:57.713728 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.713731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.713781 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.713860 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:57.714218 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.715003 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.717147 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.718355 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.718492 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.718532 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.719051 (+ 519us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.719131 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":129,"threads_started":1}
I20260807 22:41:57.719267 15556 raft_consensus.cc:2781] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:41:57.719347 15556 raft_consensus.cc:482] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:41:57.719391 15556 raft_consensus.cc:3037] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:57.719590 15196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93901144c62847e0ad2a79b82da1f6be" candidate_uuid: "7298b8b79e934ae1a56a46771453f0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bddd5710004880bb0ed45520b8b211" is_pre_election: true
I20260807 22:41:57.719696 15196 raft_consensus.cc:2454] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7298b8b79e934ae1a56a46771453f0d0 in term 0.
I20260807 22:41:57.720183 15555 raft_consensus.cc:504] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.720625 15555 leader_election.cc:288] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [CANDIDATE]: Term 1 election: Requested vote from peers 7298b8b79e934ae1a56a46771453f0d0 (127.26.52.67:35535), b5bddd5710004880bb0ed45520b8b211 (127.26.52.65:32839)
I20260807 22:41:57.720705 15556 raft_consensus.cc:504] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.720932 15480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93901144c62847e0ad2a79b82da1f6be" candidate_uuid: "b540e57a5e124cc7a8c96872d54caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7298b8b79e934ae1a56a46771453f0d0"
I20260807 22:41:57.720942 15196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93901144c62847e0ad2a79b82da1f6be" candidate_uuid: "b540e57a5e124cc7a8c96872d54caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bddd5710004880bb0ed45520b8b211"
I20260807 22:41:57.721062 15556 leader_election.cc:288] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [CANDIDATE]: Term 1 election: Requested vote from peers b540e57a5e124cc7a8c96872d54caf59 (127.26.52.66:42959), b5bddd5710004880bb0ed45520b8b211 (127.26.52.65:32839)
I20260807 22:41:57.721072 15196 raft_consensus.cc:3037] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:57.721134 15480 raft_consensus.cc:2379] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b540e57a5e124cc7a8c96872d54caf59 in current term 1: Already voted for candidate 7298b8b79e934ae1a56a46771453f0d0 in this term.
I20260807 22:41:57.721427 15337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93901144c62847e0ad2a79b82da1f6be" candidate_uuid: "7298b8b79e934ae1a56a46771453f0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b540e57a5e124cc7a8c96872d54caf59"
I20260807 22:41:57.721589 15337 raft_consensus.cc:2379] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7298b8b79e934ae1a56a46771453f0d0 in current term 1: Already voted for candidate b540e57a5e124cc7a8c96872d54caf59 in this term.
I20260807 22:41:57.722270 15196 raft_consensus.cc:2454] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b540e57a5e124cc7a8c96872d54caf59 in term 1.
I20260807 22:41:57.722569 15267 leader_election.cc:302] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b540e57a5e124cc7a8c96872d54caf59, b5bddd5710004880bb0ed45520b8b211; no voters: 7298b8b79e934ae1a56a46771453f0d0
I20260807 22:41:57.722900 15555 raft_consensus.cc:2781] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:57.722992 15196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93901144c62847e0ad2a79b82da1f6be" candidate_uuid: "7298b8b79e934ae1a56a46771453f0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bddd5710004880bb0ed45520b8b211"
I20260807 22:41:57.723150 15196 raft_consensus.cc:2379] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7298b8b79e934ae1a56a46771453f0d0 in current term 1: Already voted for candidate b540e57a5e124cc7a8c96872d54caf59 in this term.
I20260807 22:41:57.723152 15555 raft_consensus.cc:686] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 1 LEADER]: Becoming Leader. State: Replica: b540e57a5e124cc7a8c96872d54caf59, State: Running, Role: LEADER
I20260807 22:41:57.723522 15555 consensus_queue.cc:237] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } }
I20260807 22:41:57.724304 15407 leader_election.cc:302] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7298b8b79e934ae1a56a46771453f0d0; no voters: b540e57a5e124cc7a8c96872d54caf59, b5bddd5710004880bb0ed45520b8b211
I20260807 22:41:57.724488 15556 raft_consensus.cc:2726] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 22:41:57.726724 15042 catalog_manager.cc:5495] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to b540e57a5e124cc7a8c96872d54caf59 (127.26.52.66). New cstate: current_term: 1 leader_uuid: "b540e57a5e124cc7a8c96872d54caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b540e57a5e124cc7a8c96872d54caf59" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 } health_report { overall_health: UNKNOWN } } }
I20260807 22:41:57.757781 15546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.753726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47446 (local address 127.26.52.66:42959)
0807 22:41:57.753876 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:57.753881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:57.753898 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:41:57.754048 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:57.754051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:57.754113 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:57.754231 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:41:57.754517 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.755069 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.756020 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:57.756392 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:57.756508 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:57.756862 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:41:57.757322 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:41:57.757454 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:57.757534 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 22:41:57.757596 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:41:57.763921 15480 raft_consensus.cc:1261] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 1 FOLLOWER]: Refusing update from remote peer b540e57a5e124cc7a8c96872d54caf59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:57.763921 15196 raft_consensus.cc:1261] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [term 1 FOLLOWER]: Refusing update from remote peer b540e57a5e124cc7a8c96872d54caf59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:57.764633 15561 consensus_queue.cc:1035] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7298b8b79e934ae1a56a46771453f0d0" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 35535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:57.764865 15555 consensus_queue.cc:1035] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5bddd5710004880bb0ed45520b8b211" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 32839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:57.776589 15565 mvcc.cc:205] Tried to move back new op lower bound from 7316039752753229824 to 7316039752599040000. Current Snapshot: MvccSnapshot[applied={T|T < 7316039752753229824}]
I20260807 22:41:57.781828 15044 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:57.782043 15044 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:57.784781 15044 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ada8139d98cb47fc904c922791210dc2: Sending DeleteTablet for 3 replicas of tablet 93901144c62847e0ad2a79b82da1f6be
I20260807 22:41:57.785818 15176 tablet_service.cc:1514] Processing DeleteTablet for tablet 93901144c62847e0ad2a79b82da1f6be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:57 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:60836
I20260807 22:41:57.785985 15459 tablet_service.cc:1514] Processing DeleteTablet for tablet 93901144c62847e0ad2a79b82da1f6be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:57 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:58044
I20260807 22:41:57.786427 15575 tablet_replica.cc:330] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211: stopping tablet replica
I20260807 22:41:57.786428 15316 tablet_service.cc:1514] Processing DeleteTablet for tablet 93901144c62847e0ad2a79b82da1f6be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:57 UTC) from {username='kudu', principal='kudu/127.26.52.126@KRBTEST.COM'} at 127.0.0.1:47436
I20260807 22:41:57.786618 15577 tablet_replica.cc:330] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: stopping tablet replica
I20260807 22:41:57.786972 15577 raft_consensus.cc:2229] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:57.786967 15575 raft_consensus.cc:2229] T 93901144c62847e0ad2a79b82da1f6be P b5bddd5710004880bb0ed45520b8b211 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:57.787312 15577 raft_consensus.cc:2258] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:57.787379 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 15110
I20260807 22:41:57.789788 15577 ts_tablet_manager.cc:1905] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:57.792385 15578 tablet_replica.cc:330] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: stopping tablet replica
I20260807 22:41:57.792897 15578 raft_consensus.cc:2229] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:41:57.793388 15578 raft_consensus.cc:2258] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:57.793531 15577 ts_tablet_manager.cc:1918] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:57.793648 15577 log.cc:1196] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/93901144c62847e0ad2a79b82da1f6be
I20260807 22:41:57.794021 15577 ts_tablet_manager.cc:1939] T 93901144c62847e0ad2a79b82da1f6be P 7298b8b79e934ae1a56a46771453f0d0: Deleting consensus metadata
I20260807 22:41:57.795495 15028 catalog_manager.cc:4841] TS 7298b8b79e934ae1a56a46771453f0d0 (127.26.52.67:35535): tablet 93901144c62847e0ad2a79b82da1f6be (table test-table [id=c7111b2f7c9542bf8e6edd3e4629a40c]) successfully deleted
I20260807 22:41:57.795833 15578 ts_tablet_manager.cc:1905] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:57.799144 15578 ts_tablet_manager.cc:1918] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:57.799273 15578 log.cc:1196] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/93901144c62847e0ad2a79b82da1f6be
I20260807 22:41:57.799726 15578 ts_tablet_manager.cc:1939] T 93901144c62847e0ad2a79b82da1f6be P b540e57a5e124cc7a8c96872d54caf59: Deleting consensus metadata
W20260807 22:41:57.800056 15027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:32839 (error 108)
I20260807 22:41:57.800999 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 15249
I20260807 22:41:57.803222 15027 catalog_manager.cc:4841] TS b540e57a5e124cc7a8c96872d54caf59 (127.26.52.66:42959): tablet 93901144c62847e0ad2a79b82da1f6be (table test-table [id=c7111b2f7c9542bf8e6edd3e4629a40c]) successfully deleted
I20260807 22:41:57.808461 15545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:57.807977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:32839 (local address 127.0.0.1:60842)
0807 22:41:57.808196 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:57.808321 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:32839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260807 22:41:57.808779 15027 catalog_manager.cc:4584] TS b5bddd5710004880bb0ed45520b8b211 (127.26.52.65:32839): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 93901144c62847e0ad2a79b82da1f6be: Network error: Client connection negotiation failed: client connection to 127.26.52.65:32839: connect: Connection refused (error 111)
I20260807 22:41:57.811435 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 15391
I20260807 22:41:57.820781 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 15011
2026-08-07T22:41:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2440 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T22:41:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:41:57Z Disabled control of system clock
I20260807 22:41:57.856086 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40123
--webserver_interface=127.26.52.126
--webserver_port=0
--builtin_ntp_servers=127.26.52.84:39119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:40123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:41:57.975399 15583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:57.975677 15583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:57.975714 15583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:57.979777 15583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:57.979840 15583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:57.979856 15583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:57.979873 15583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:57.979888 15583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:57.984745 15583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:40123
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:57.985849 15583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:57.987216 15583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:57.995934 15589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:57.995976 15588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:57.995985 15591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:57.996347 15583 server_base.cc:1034] running on GCE node
I20260807 22:41:57.996960 15583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:57.998075 15583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:57.999238 15583 hybrid_clock.cc:648] HybridClock initialized: now 1786142517999209 us; error 43 us; skew 500 ppm
I20260807 22:41:58.001283 15583 webserver.cc:460] Webserver started at http://127.26.52.126:46759/ using document root <none> and password file <none>
I20260807 22:41:58.001901 15583 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:58.002012 15583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:58.002242 15583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:58.004451 15583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "5d32ad24890f443f88498bab2e8511bf"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "9c53ea942d970d33de944a24617def4a"
server_key_iv: "05f8e5ccc745f3d65a4adc13a75c13ff"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.005053 15583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "5d32ad24890f443f88498bab2e8511bf"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "9c53ea942d970d33de944a24617def4a"
server_key_iv: "05f8e5ccc745f3d65a4adc13a75c13ff"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.009274 15583 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 22:41:58.012029 15598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:58.013439 15583 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:41:58.013567 15583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "5d32ad24890f443f88498bab2e8511bf"
format_stamp: "Formatted at 2026-08-07 22:41:57 on dist-test-slave-8w9v"
server_key: "9c53ea942d970d33de944a24617def4a"
server_key_iv: "05f8e5ccc745f3d65a4adc13a75c13ff"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.013674 15583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:58.046749 15583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:58.047541 15583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:58.047710 15583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:58.055100 15583 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:40123
I20260807 22:41:58.055105 15653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:40123 every 8 connection(s)
I20260807 22:41:58.056110 15583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:58.059295 15654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:58.063262 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 15583
I20260807 22:41:58.063423 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:41:58.063802 26833 external_mini_cluster.cc:1428] Setting key b679c0be07bd2719f4be600e4b57c560
I20260807 22:41:58.065886 15654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf: Bootstrap starting.
I20260807 22:41:58.068804 15654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:58.069751 15654 log.cc:824] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:58.072022 15654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf: No bootstrap required, opened a new log
I20260807 22:41:58.074833 15657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.065450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52816 (local address 127.26.52.126:40123)
0807 22:41:58.066185 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.066206 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.066251 (+ 45us) server_negotiation.cc:407] Connection header received
0807 22:41:58.067141 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.067169 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.067703 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.068071 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:58.068570 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.070045 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.071078 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.071752 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.071918 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.072769 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:58.072776 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:58.072791 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:58.073290 (+ 499us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:58.073360 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:58.073385 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:58.073500 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.073594 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.073865 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":120,"threads_started":1}
I20260807 22:41:58.076807 15654 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d32ad24890f443f88498bab2e8511bf" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40123 } }
I20260807 22:41:58.077077 15654 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:58.077147 15654 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d32ad24890f443f88498bab2e8511bf, State: Initialized, Role: FOLLOWER
I20260807 22:41:58.077572 15654 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d32ad24890f443f88498bab2e8511bf" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40123 } }
I20260807 22:41:58.077709 15654 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:58.077756 15654 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:58.077824 15654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:58.078740 15654 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d32ad24890f443f88498bab2e8511bf" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40123 } }
I20260807 22:41:58.079056 15654 leader_election.cc:302] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d32ad24890f443f88498bab2e8511bf; no voters:
I20260807 22:41:58.079320 15654 leader_election.cc:288] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:41:58.079469 15659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:58.079734 15659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [term 1 LEADER]: Becoming Leader. State: Replica: 5d32ad24890f443f88498bab2e8511bf, State: Running, Role: LEADER
I20260807 22:41:58.080075 15659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d32ad24890f443f88498bab2e8511bf" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40123 } }
I20260807 22:41:58.080669 15654 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:58.081929 15661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d32ad24890f443f88498bab2e8511bf. Latest consensus state: current_term: 1 leader_uuid: "5d32ad24890f443f88498bab2e8511bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d32ad24890f443f88498bab2e8511bf" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40123 } } }
I20260807 22:41:58.081934 15660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d32ad24890f443f88498bab2e8511bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d32ad24890f443f88498bab2e8511bf" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40123 } } }
I20260807 22:41:58.082085 15660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:58.082085 15661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:58.082597 15668 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:58.085754 15668 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:58.092020 15668 catalog_manager.cc:1347] Generated new cluster ID: 676eda1a7b67465aacbbfbb76d19ea84
I20260807 22:41:58.092116 15668 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:58.109354 15668 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:41:58.110363 15668 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:58.114516 15668 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf: Generated new TSK 0
I20260807 22:41:58.115245 15668 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:41:58.119580 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.65:0
--local_ip_for_outbound_sockets=127.26.52.65
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40123
--builtin_ntp_servers=127.26.52.84:39119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:41:58.236214 15679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:58.236500 15679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:58.236541 15679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:58.240676 15679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:58.240736 15679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:58.240828 15679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.65
I20260807 22:41:58.245754 15679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.52.65
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.65
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:58.247011 15679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:58.248521 15679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:58.258270 15685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:58.258282 15687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:58.258275 15684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:58.258663 15679 server_base.cc:1034] running on GCE node
I20260807 22:41:58.259236 15679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:58.259855 15679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:58.261011 15679 hybrid_clock.cc:648] HybridClock initialized: now 1786142518260970 us; error 55 us; skew 500 ppm
I20260807 22:41:58.262813 15679 webserver.cc:460] Webserver started at http://127.26.52.65:35999/ using document root <none> and password file <none>
I20260807 22:41:58.263371 15679 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:58.263440 15679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:58.263633 15679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:58.265766 15679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/data/instance:
uuid: "8b543163d8a84ec58d800271cc7d388e"
format_stamp: "Formatted at 2026-08-07 22:41:58 on dist-test-slave-8w9v"
server_key: "383efd47ffb9e0f92ebaefcaa3db4289"
server_key_iv: "d568a1fe34855298ba01f30555e2f5f6"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.266317 15679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance:
uuid: "8b543163d8a84ec58d800271cc7d388e"
format_stamp: "Formatted at 2026-08-07 22:41:58 on dist-test-slave-8w9v"
server_key: "383efd47ffb9e0f92ebaefcaa3db4289"
server_key_iv: "d568a1fe34855298ba01f30555e2f5f6"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.270084 15679 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260807 22:41:58.272521 15693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:58.273736 15679 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:41:58.273869 15679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/wal
uuid: "8b543163d8a84ec58d800271cc7d388e"
format_stamp: "Formatted at 2026-08-07 22:41:58 on dist-test-slave-8w9v"
server_key: "383efd47ffb9e0f92ebaefcaa3db4289"
server_key_iv: "d568a1fe34855298ba01f30555e2f5f6"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.273989 15679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:58.301649 15679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:58.302410 15679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:58.302623 15679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:58.303254 15679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:58.304334 15679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:58.304404 15679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:58.304500 15679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:58.304546 15679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:58.313666 15679 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.65:36613
I20260807 22:41:58.313691 15811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.65:36613 every 8 connection(s)
I20260807 22:41:58.314651 15679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:58.317153 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 15679
I20260807 22:41:58.317305 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-0/wal/instance
I20260807 22:41:58.317678 26833 external_mini_cluster.cc:1428] Setting key 1214d76dd593cad30490c5e089f168a3
I20260807 22:41:58.319985 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.66:0
--local_ip_for_outbound_sockets=127.26.52.66
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40123
--builtin_ntp_servers=127.26.52.84:39119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:41:58.325531 15657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.316660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:44571 (local address 127.26.52.126:40123)
0807 22:41:58.316820 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.316824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.318151 (+ 1327us) server_negotiation.cc:407] Connection header received
0807 22:41:58.319876 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.319878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.319921 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.319998 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:58.321253 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.321968 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.323138 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.323562 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.323687 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.324874 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:58.324880 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:58.324885 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:58.324905 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:58.324944 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:58.324960 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:58.325050 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.325233 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.325314 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:41:58.326484 15814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.317098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40123 (local address 127.26.52.65:44571)
0807 22:41:58.317962 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:58.318021 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:58.319643 (+ 1622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:58.320221 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:58.320232 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:58.320342 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:58.321084 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.321105 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.322100 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.322103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.323007 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.323017 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.323712 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.323714 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.323855 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.324556 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:58.324558 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:58.324623 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:58.324703 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:58.325048 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:58.325055 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:58.325060 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:41:58.325204 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 22:41:58.325501 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":168,"threads_started":1}
I20260807 22:41:58.327817 15812 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40123
I20260807 22:41:58.328087 15812 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:58.328698 15812 heartbeater.cc:511] Master 127.26.52.126:40123 requested a full tablet report, sending...
I20260807 22:41:58.330304 15615 ts_manager.cc:194] Registered new tserver with Master: 8b543163d8a84ec58d800271cc7d388e (127.26.52.65:36613)
I20260807 22:41:58.331486 15615 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.65:44571
W20260807 22:41:58.435473 15815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:58.435739 15815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:58.435777 15815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:58.439878 15815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:58.439942 15815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:58.440043 15815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.66
I20260807 22:41:58.444854 15815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.52.66
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.66
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:58.445955 15815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:58.447327 15815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:41:58.457778 15815 server_base.cc:1034] running on GCE node
W20260807 22:41:58.457728 15822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:58.457728 15821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:58.457728 15824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:58.458454 15815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:58.459080 15815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:58.460194 15815 hybrid_clock.cc:648] HybridClock initialized: now 1786142518460179 us; error 28 us; skew 500 ppm
I20260807 22:41:58.462263 15815 webserver.cc:460] Webserver started at http://127.26.52.66:40903/ using document root <none> and password file <none>
I20260807 22:41:58.462867 15815 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:58.462951 15815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:58.463172 15815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:58.465304 15815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/data/instance:
uuid: "19925102bb1744debe921d393544341a"
format_stamp: "Formatted at 2026-08-07 22:41:58 on dist-test-slave-8w9v"
server_key: "0414361a196bc5d41aad1dc571583c57"
server_key_iv: "494eb3dde814045c5bcd8cd54c3ed923"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.465828 15815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance:
uuid: "19925102bb1744debe921d393544341a"
format_stamp: "Formatted at 2026-08-07 22:41:58 on dist-test-slave-8w9v"
server_key: "0414361a196bc5d41aad1dc571583c57"
server_key_iv: "494eb3dde814045c5bcd8cd54c3ed923"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.469645 15815 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:41:58.471901 15830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:58.473140 15815 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:41:58.473282 15815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/wal
uuid: "19925102bb1744debe921d393544341a"
format_stamp: "Formatted at 2026-08-07 22:41:58 on dist-test-slave-8w9v"
server_key: "0414361a196bc5d41aad1dc571583c57"
server_key_iv: "494eb3dde814045c5bcd8cd54c3ed923"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.473385 15815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:58.485890 15815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:58.486609 15815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:58.486804 15815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:58.487468 15815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:58.488482 15815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:58.488531 15815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:58.488597 15815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:58.488638 15815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:58.497605 15815 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.66:42325
I20260807 22:41:58.497627 15947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.66:42325 every 8 connection(s)
I20260807 22:41:58.498562 15815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:58.507728 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 15815
I20260807 22:41:58.507859 15657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.500505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.66:58977 (local address 127.26.52.126:40123)
0807 22:41:58.500645 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.500649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.501712 (+ 1063us) server_negotiation.cc:407] Connection header received
0807 22:41:58.503142 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.503146 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.503205 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.503305 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:58.504217 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.504767 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.505912 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.506135 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.506245 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.507327 (+ 1082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:58.507330 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:58.507332 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:58.507345 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:58.507363 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:58.507371 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:58.507470 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.507628 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.507695 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:41:58.507989 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/wal/instance
I20260807 22:41:58.508407 26833 external_mini_cluster.cc:1428] Setting key 2e3e1c303341effe308737ef5b72167d
I20260807 22:41:58.508967 15950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.500901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40123 (local address 127.26.52.66:58977)
0807 22:41:58.501563 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:58.501605 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:58.502925 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:58.503478 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:58.503485 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:58.503573 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:58.504050 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.504062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.504902 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.504914 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.505779 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.505789 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.506293 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.506297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.506459 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.507057 (+ 598us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:58.507058 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:58.507097 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:58.507160 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:58.507471 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:58.507483 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:58.507492 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 22:41:58.507625 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 22:41:58.507940 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":111,"threads_started":1}
I20260807 22:41:58.510162 15948 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40123
I20260807 22:41:58.510440 15948 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:58.510804 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.52.67:0
--local_ip_for_outbound_sockets=127.26.52.67
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40123
--builtin_ntp_servers=127.26.52.84:39119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:41:58.511039 15948 heartbeater.cc:511] Master 127.26.52.126:40123 requested a full tablet report, sending...
I20260807 22:41:58.512215 15615 ts_manager.cc:194] Registered new tserver with Master: 19925102bb1744debe921d393544341a (127.26.52.66:42325)
I20260807 22:41:58.512856 15615 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.66:58977
W20260807 22:41:58.630748 15951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:58.631034 15951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:58.631073 15951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:58.635023 15951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:58.635078 15951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:58.635133 15951 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.52.67
I20260807 22:41:58.639842 15951 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.52.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.52.67
--webserver_port=0
--tserver_master_addrs=127.26.52.126:40123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.52.67
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:41:58.640973 15951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:58.642359 15951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:58.652550 15957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:58.652527 15960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:58.652590 15951 server_base.cc:1034] running on GCE node
W20260807 22:41:58.652531 15956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:58.653306 15951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:58.653995 15951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:58.655181 15951 hybrid_clock.cc:648] HybridClock initialized: now 1786142518655165 us; error 29 us; skew 500 ppm
I20260807 22:41:58.657202 15951 webserver.cc:460] Webserver started at http://127.26.52.67:34759/ using document root <none> and password file <none>
I20260807 22:41:58.657869 15951 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:58.657977 15951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:58.658228 15951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:58.660513 15951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/data/instance:
uuid: "5fb0c90f7450490aab4f28501f764cfc"
format_stamp: "Formatted at 2026-08-07 22:41:58 on dist-test-slave-8w9v"
server_key: "c614455948fe4a2d9afc30252463d88f"
server_key_iv: "083095b035816ea5a567f6106c985a7b"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.661057 15951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance:
uuid: "5fb0c90f7450490aab4f28501f764cfc"
format_stamp: "Formatted at 2026-08-07 22:41:58 on dist-test-slave-8w9v"
server_key: "c614455948fe4a2d9afc30252463d88f"
server_key_iv: "083095b035816ea5a567f6106c985a7b"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.664888 15951 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:41:58.667714 15967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:58.669107 15951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:41:58.669291 15951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/wal
uuid: "5fb0c90f7450490aab4f28501f764cfc"
format_stamp: "Formatted at 2026-08-07 22:41:58 on dist-test-slave-8w9v"
server_key: "c614455948fe4a2d9afc30252463d88f"
server_key_iv: "083095b035816ea5a567f6106c985a7b"
server_key_version: "encryptionkey@0"
I20260807 22:41:58.669412 15951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:58.686450 15951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:58.687216 15951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:58.687438 15951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:58.688053 15951 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:58.689136 15951 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:58.689206 15951 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:58.689304 15951 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:58.689353 15951 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:58.698629 15951 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.67:41917
I20260807 22:41:58.698647 16084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.67:41917 every 8 connection(s)
I20260807 22:41:58.699656 15951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:58.708837 15657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.701661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.67:50693 (local address 127.26.52.126:40123)
0807 22:41:58.701821 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.701826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.702928 (+ 1102us) server_negotiation.cc:407] Connection header received
0807 22:41:58.704334 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.704337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.704385 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.704463 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:58.705306 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.705833 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.706924 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.707144 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.707230 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.708400 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:58.708403 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:58.708405 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:58.708421 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:58.708441 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:58.708449 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:58.708520 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.708659 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.708712 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 22:41:58.709328 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 15951
I20260807 22:41:58.709491 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/wal/instance
I20260807 22:41:58.709818 26833 external_mini_cluster.cc:1428] Setting key ec3e6f7362d46007b0d61a0f0e49f2a5
I20260807 22:41:58.709904 16087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.702110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:40123 (local address 127.26.52.67:50693)
0807 22:41:58.702777 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:58.702818 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:58.704080 (+ 1262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:58.704621 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:58.704627 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:58.704706 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:58.705187 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.705198 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.705938 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.705940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.706807 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.706817 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.707281 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.707284 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.707436 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.708081 (+ 645us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:58.708083 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:58.708161 (+ 78us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:58.708241 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:58.708534 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:58.708542 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:58.708546 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:41:58.708640 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:41:58.708858 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":123,"threads_started":1}
I20260807 22:41:58.711107 16085 heartbeater.cc:347] Connected to a master server at 127.26.52.126:40123
I20260807 22:41:58.711345 16085 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:58.711930 16085 heartbeater.cc:511] Master 127.26.52.126:40123 requested a full tablet report, sending...
I20260807 22:41:58.712967 15614 ts_manager.cc:194] Registered new tserver with Master: 5fb0c90f7450490aab4f28501f764cfc (127.26.52.67:41917)
I20260807 22:41:58.713575 15614 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.52.67:50693
I20260807 22:41:58.723863 26833 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:41:58.729424 15657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.725961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52824 (local address 127.26.52.126:40123)
0807 22:41:58.726112 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.726117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.726274 (+ 157us) server_negotiation.cc:407] Connection header received
0807 22:41:58.726378 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.726380 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.726422 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.726488 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:58.726714 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.727219 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.727994 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.728249 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.728327 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.729027 (+ 700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:58.729031 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:58.729033 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:58.729044 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:58.729061 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:58.729069 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:58.729126 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.729199 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.729248 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:41:58.732434 15614 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52824:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:41:58.735496 15614 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:41:58.750197 16098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.743845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:42325 (local address 127.0.0.1:51440)
0807 22:41:58.744893 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:58.744969 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:58.745129 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:58.745874 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:58.745880 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:58.745918 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:58.746089 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.746101 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.747195 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.747200 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.748633 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.748644 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.749596 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.749600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.749705 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.749751 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 22:41:58.749878 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 22:41:58.750027 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"mutex_wait_us":65,"spinlock_wait_cycles":10112,"thread_start_us":90,"threads_started":1}
I20260807 22:41:58.750206 16100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.744021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51440 (local address 127.26.52.66:42325)
0807 22:41:58.744517 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.744534 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.745279 (+ 745us) server_negotiation.cc:407] Connection header received
0807 22:41:58.745366 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.745375 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.745593 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.745742 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:58.746336 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.747074 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.748758 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.749456 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.749562 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.749767 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.749918 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.750035 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":278,"threads_started":1}
I20260807 22:41:58.750738 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.743912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:41917 (local address 127.0.0.1:34208)
0807 22:41:58.744969 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:58.744985 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:58.745128 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:58.745971 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:58.745974 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:58.745992 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:58.746099 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.746106 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.747570 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.747573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.749012 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.749024 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.750242 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.750246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.750374 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.750443 (+ 69us) client_negotiation.cc:769] Sending connection context
0807 22:41:58.750517 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:41:58.750596 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":968,"mutex_wait_us":165,"spinlock_wait_cycles":1408,"thread_start_us":116,"threads_started":1}
I20260807 22:41:58.750758 16099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.744646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:36613 (local address 127.0.0.1:50862)
0807 22:41:58.745372 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:58.745384 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:58.745468 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:58.746138 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:58.746143 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:58.746165 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:58.746239 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.746245 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.747615 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.747619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.749022 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.749028 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.750262 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.750266 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.750391 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.750450 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 22:41:58.750518 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 22:41:58.750602 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":252,"thread_start_us":90,"threads_started":1}
I20260807 22:41:58.750953 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.744799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34208 (local address 127.26.52.67:41917)
0807 22:41:58.745557 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.745568 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.745590 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:41:58.745666 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.745674 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.745846 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.745985 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:58.746233 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.747449 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.749167 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.749915 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.750010 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.750176 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.750553 (+ 377us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.750644 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":167,"threads_started":1}
I20260807 22:41:58.751328 16102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.744806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50862 (local address 127.26.52.65:36613)
0807 22:41:58.745248 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.745261 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.745568 (+ 307us) server_negotiation.cc:407] Connection header received
0807 22:41:58.745655 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.745663 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.745846 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.746014 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:58.746353 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.747528 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.749149 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.749918 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.750021 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.750190 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.751061 (+ 871us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.751166 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":122,"threads_started":1}
I20260807 22:41:58.753544 15880 tablet_service.cc:1467] Processing CreateTablet for tablet 3b30f2d14bb64b4b9e1efba974209472 (DEFAULT_TABLE table=test-table [id=74637b2d0d82419a9462b3709161ce56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:58.753676 15742 tablet_service.cc:1467] Processing CreateTablet for tablet 3b30f2d14bb64b4b9e1efba974209472 (DEFAULT_TABLE table=test-table [id=74637b2d0d82419a9462b3709161ce56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:58.753676 16017 tablet_service.cc:1467] Processing CreateTablet for tablet 3b30f2d14bb64b4b9e1efba974209472 (DEFAULT_TABLE table=test-table [id=74637b2d0d82419a9462b3709161ce56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:58.754483 15880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b30f2d14bb64b4b9e1efba974209472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:58.754678 15742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b30f2d14bb64b4b9e1efba974209472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:58.754678 16017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b30f2d14bb64b4b9e1efba974209472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:58.760922 16105 tablet_bootstrap.cc:492] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: Bootstrap starting.
I20260807 22:41:58.762346 16107 tablet_bootstrap.cc:492] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: Bootstrap starting.
I20260807 22:41:58.764271 16105 tablet_bootstrap.cc:654] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:58.764390 16107 tablet_bootstrap.cc:654] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:58.764485 16108 tablet_bootstrap.cc:492] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e: Bootstrap starting.
I20260807 22:41:58.765218 16105 log.cc:824] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:58.765219 16107 log.cc:824] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:58.766369 16108 tablet_bootstrap.cc:654] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:58.767201 16108 log.cc:824] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:58.767354 16107 tablet_bootstrap.cc:492] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: No bootstrap required, opened a new log
I20260807 22:41:58.767485 16105 tablet_bootstrap.cc:492] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: No bootstrap required, opened a new log
I20260807 22:41:58.767601 16107 ts_tablet_manager.cc:1397] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 22:41:58.767765 16105 ts_tablet_manager.cc:1397] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260807 22:41:58.769435 16108 tablet_bootstrap.cc:492] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e: No bootstrap required, opened a new log
I20260807 22:41:58.769680 16108 ts_tablet_manager.cc:1397] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 22:41:58.771167 16107 raft_consensus.cc:348] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 } } peers { permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 } } peers { permanent_uuid: "8b543163d8a84ec58d800271cc7d388e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36613 } }
I20260807 22:41:58.771415 16107 raft_consensus.cc:374] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:58.771488 16107 raft_consensus.cc:729] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb0c90f7450490aab4f28501f764cfc, State: Initialized, Role: FOLLOWER
I20260807 22:41:58.772017 16107 consensus_queue.cc:260] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 } } peers { permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 } } peers { permanent_uuid: "8b543163d8a84ec58d800271cc7d388e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36613 } }
I20260807 22:41:58.772169 16105 raft_consensus.cc:348] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 } } peers { permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 } } peers { permanent_uuid: "8b543163d8a84ec58d800271cc7d388e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36613 } }
I20260807 22:41:58.772415 16105 raft_consensus.cc:374] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:58.772488 16105 raft_consensus.cc:729] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19925102bb1744debe921d393544341a, State: Initialized, Role: FOLLOWER
I20260807 22:41:58.772902 16085 heartbeater.cc:503] Master 127.26.52.126:40123 was elected leader, sending a full tablet report...
I20260807 22:41:58.772924 16105 consensus_queue.cc:260] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 } } peers { permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 } } peers { permanent_uuid: "8b543163d8a84ec58d800271cc7d388e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36613 } }
I20260807 22:41:58.773232 16107 ts_tablet_manager.cc:1428] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 22:41:58.773942 16105 ts_tablet_manager.cc:1428] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 22:41:58.774264 15948 heartbeater.cc:503] Master 127.26.52.126:40123 was elected leader, sending a full tablet report...
I20260807 22:41:58.775251 16108 raft_consensus.cc:348] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 } } peers { permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 } } peers { permanent_uuid: "8b543163d8a84ec58d800271cc7d388e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36613 } }
I20260807 22:41:58.775528 16108 raft_consensus.cc:374] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:58.775595 16108 raft_consensus.cc:729] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b543163d8a84ec58d800271cc7d388e, State: Initialized, Role: FOLLOWER
I20260807 22:41:58.776057 16108 consensus_queue.cc:260] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 } } peers { permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 } } peers { permanent_uuid: "8b543163d8a84ec58d800271cc7d388e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36613 } }
I20260807 22:41:58.777076 16108 ts_tablet_manager.cc:1428] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 22:41:58.777415 15812 heartbeater.cc:503] Master 127.26.52.126:40123 was elected leader, sending a full tablet report...
W20260807 22:41:58.815995 15813 tablet.cc:2369] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:41:58.817500 16115 raft_consensus.cc:482] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:58.817677 16115 raft_consensus.cc:504] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 } } peers { permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 } } peers { permanent_uuid: "8b543163d8a84ec58d800271cc7d388e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36613 } }
I20260807 22:41:58.818877 16115 leader_election.cc:288] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19925102bb1744debe921d393544341a (127.26.52.66:42325), 5fb0c90f7450490aab4f28501f764cfc (127.26.52.67:41917)
I20260807 22:41:58.822908 15814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.819198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.67:41917 (local address 127.26.52.65:57275)
0807 22:41:58.819305 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:58.819322 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:58.819423 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:58.819742 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:58.819744 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:58.819764 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:58.819872 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.819877 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.820851 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.820855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.821792 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.821802 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.822592 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.822595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.822671 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.822692 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 22:41:58.822752 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 22:41:58.822803 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260807 22:41:58.823012 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.819298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:57275 (local address 127.26.52.67:41917)
0807 22:41:58.819466 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.819473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.819490 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:41:58.819553 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.819556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.819610 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.819690 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:58.819987 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.820735 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.821929 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.822477 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.822593 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.822641 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.822784 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.822856 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 22:41:58.823485 16116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.819198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.66:42325 (local address 127.26.52.65:52709)
0807 22:41:58.819968 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:58.819981 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:58.820085 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:58.820344 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:58.820348 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:58.820366 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:58.820483 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.820488 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.821171 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.821175 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.822173 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:58.822183 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.823032 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.823039 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:58.823161 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.823187 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 22:41:58.823261 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:41:58.823319 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"mutex_wait_us":297,"thread_start_us":146,"threads_started":1}
I20260807 22:41:58.823514 16100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.819298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.52.65:52709 (local address 127.26.52.66:42325)
0807 22:41:58.819453 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.819457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.820069 (+ 612us) server_negotiation.cc:407] Connection header received
0807 22:41:58.820200 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.820202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.820248 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.820307 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:58.820595 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.821053 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.822310 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.822884 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.822999 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.823054 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.823303 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.823384 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 22:41:58.823783 16037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b30f2d14bb64b4b9e1efba974209472" candidate_uuid: "8b543163d8a84ec58d800271cc7d388e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb0c90f7450490aab4f28501f764cfc" is_pre_election: true
I20260807 22:41:58.824110 16037 raft_consensus.cc:2454] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b543163d8a84ec58d800271cc7d388e in term 0.
I20260807 22:41:58.824277 15900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b30f2d14bb64b4b9e1efba974209472" candidate_uuid: "8b543163d8a84ec58d800271cc7d388e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19925102bb1744debe921d393544341a" is_pre_election: true
I20260807 22:41:58.824570 15900 raft_consensus.cc:2454] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b543163d8a84ec58d800271cc7d388e in term 0.
I20260807 22:41:58.824688 15694 leader_election.cc:302] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb0c90f7450490aab4f28501f764cfc, 8b543163d8a84ec58d800271cc7d388e; no voters:
I20260807 22:41:58.824985 16115 raft_consensus.cc:2781] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:41:58.825088 16115 raft_consensus.cc:482] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:41:58.825135 16115 raft_consensus.cc:3037] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:58.826251 16115 raft_consensus.cc:504] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 } } peers { permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 } } peers { permanent_uuid: "8b543163d8a84ec58d800271cc7d388e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36613 } }
I20260807 22:41:58.826617 16115 leader_election.cc:288] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [CANDIDATE]: Term 1 election: Requested vote from peers 19925102bb1744debe921d393544341a (127.26.52.66:42325), 5fb0c90f7450490aab4f28501f764cfc (127.26.52.67:41917)
I20260807 22:41:58.826938 15900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b30f2d14bb64b4b9e1efba974209472" candidate_uuid: "8b543163d8a84ec58d800271cc7d388e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19925102bb1744debe921d393544341a"
I20260807 22:41:58.827023 16037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b30f2d14bb64b4b9e1efba974209472" candidate_uuid: "8b543163d8a84ec58d800271cc7d388e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb0c90f7450490aab4f28501f764cfc"
I20260807 22:41:58.827069 15900 raft_consensus.cc:3037] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:58.827143 16037 raft_consensus.cc:3037] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:58.828436 15900 raft_consensus.cc:2454] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b543163d8a84ec58d800271cc7d388e in term 1.
I20260807 22:41:58.828442 16037 raft_consensus.cc:2454] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b543163d8a84ec58d800271cc7d388e in term 1.
I20260807 22:41:58.828773 15697 leader_election.cc:302] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19925102bb1744debe921d393544341a, 8b543163d8a84ec58d800271cc7d388e; no voters:
I20260807 22:41:58.829020 16115 raft_consensus.cc:2781] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:58.829274 16115 raft_consensus.cc:686] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [term 1 LEADER]: Becoming Leader. State: Replica: 8b543163d8a84ec58d800271cc7d388e, State: Running, Role: LEADER
I20260807 22:41:58.829600 16115 consensus_queue.cc:237] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 } } peers { permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 } } peers { permanent_uuid: "8b543163d8a84ec58d800271cc7d388e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36613 } }
I20260807 22:41:58.832916 15614 catalog_manager.cc:5495] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b543163d8a84ec58d800271cc7d388e (127.26.52.65). New cstate: current_term: 1 leader_uuid: "8b543163d8a84ec58d800271cc7d388e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b543163d8a84ec58d800271cc7d388e" member_type: VOTER last_known_addr { host: "127.26.52.65" port: 36613 } health_report { overall_health: HEALTHY } } }
I20260807 22:41:58.849466 16102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.845867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50868 (local address 127.26.52.65:36613)
0807 22:41:58.845996 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:58.846000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:58.846021 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:41:58.846162 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:58.846165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:58.846223 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:58.846326 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:41:58.846590 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.847085 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.847937 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:58.848223 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:58.848329 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:58.848651 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:41:58.849058 (+ 407us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:41:58.849194 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:58.849257 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 22:41:58.849310 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:41:58.855369 16037 raft_consensus.cc:1261] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc [term 1 FOLLOWER]: Refusing update from remote peer 8b543163d8a84ec58d800271cc7d388e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:58.855384 15900 raft_consensus.cc:1261] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a [term 1 FOLLOWER]: Refusing update from remote peer 8b543163d8a84ec58d800271cc7d388e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:58.856065 16117 consensus_queue.cc:1035] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb0c90f7450490aab4f28501f764cfc" member_type: VOTER last_known_addr { host: "127.26.52.67" port: 41917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:58.856288 16115 consensus_queue.cc:1035] T 3b30f2d14bb64b4b9e1efba974209472 P 8b543163d8a84ec58d800271cc7d388e [LEADER]: Connected to new peer: Peer: permanent_uuid: "19925102bb1744debe921d393544341a" member_type: VOTER last_known_addr { host: "127.26.52.66" port: 42325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:58.866081 16121 mvcc.cc:205] Tried to move back new op lower bound from 7316039757223948288 to 7316039757128622080. Current Snapshot: MvccSnapshot[applied={T|T < 7316039757223948288}]
I20260807 22:41:58.873797 15613 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:58.873982 15613 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:58.876528 15613 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d32ad24890f443f88498bab2e8511bf: Sending DeleteTablet for 3 replicas of tablet 3b30f2d14bb64b4b9e1efba974209472
I20260807 22:41:58.877388 15880 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b30f2d14bb64b4b9e1efba974209472 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:58 UTC) from {username='slave'} at 127.0.0.1:51440
I20260807 22:41:58.877570 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b30f2d14bb64b4b9e1efba974209472 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:58 UTC) from {username='slave'} at 127.0.0.1:50862
I20260807 22:41:58.877592 16017 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b30f2d14bb64b4b9e1efba974209472 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:58 UTC) from {username='slave'} at 127.0.0.1:34208
I20260807 22:41:58.878098 16131 tablet_replica.cc:330] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: stopping tablet replica
I20260807 22:41:58.878472 16131 raft_consensus.cc:2229] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:58.878779 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 15679
I20260807 22:41:58.878835 16131 raft_consensus.cc:2258] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:58.881479 16131 ts_tablet_manager.cc:1905] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:58.885257 16131 ts_tablet_manager.cc:1918] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:58.885382 16131 log.cc:1196] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-1/wal/wals/3b30f2d14bb64b4b9e1efba974209472
I20260807 22:41:58.885708 16131 ts_tablet_manager.cc:1939] T 3b30f2d14bb64b4b9e1efba974209472 P 19925102bb1744debe921d393544341a: Deleting consensus metadata
I20260807 22:41:58.887228 15602 catalog_manager.cc:4841] TS 19925102bb1744debe921d393544341a (127.26.52.66:42325): tablet 3b30f2d14bb64b4b9e1efba974209472 (table test-table [id=74637b2d0d82419a9462b3709161ce56]) successfully deleted
W20260807 22:41:58.888770 15600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.52.65:36613 (error 108)
I20260807 22:41:58.889081 16132 tablet_replica.cc:330] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: stopping tablet replica
I20260807 22:41:58.889441 16132 raft_consensus.cc:2229] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:58.889698 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 15815
I20260807 22:41:58.889837 16132 raft_consensus.cc:2258] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:58.889958 16099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:58.889590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.65:36613 (local address 127.0.0.1:50876)
0807 22:41:58.889779 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:58.889861 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.65:36613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260807 22:41:58.890915 15600 catalog_manager.cc:4584] TS 8b543163d8a84ec58d800271cc7d388e (127.26.52.65:36613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b30f2d14bb64b4b9e1efba974209472: Network error: Client connection negotiation failed: client connection to 127.26.52.65:36613: connect: Connection refused (error 111)
I20260807 22:41:58.892596 16132 ts_tablet_manager.cc:1905] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:58.894899 16132 ts_tablet_manager.cc:1918] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:58.894996 16132 log.cc:1196] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: Deleting WAL directory at /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142258649536-26833-0/minicluster-data/ts-2/wal/wals/3b30f2d14bb64b4b9e1efba974209472
I20260807 22:41:58.895277 16132 ts_tablet_manager.cc:1939] T 3b30f2d14bb64b4b9e1efba974209472 P 5fb0c90f7450490aab4f28501f764cfc: Deleting consensus metadata
I20260807 22:41:58.896636 15599 catalog_manager.cc:4841] TS 5fb0c90f7450490aab4f28501f764cfc (127.26.52.67:41917): tablet 3b30f2d14bb64b4b9e1efba974209472 (table test-table [id=74637b2d0d82419a9462b3709161ce56]) successfully deleted
I20260807 22:41:58.898114 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 15951
I20260807 22:41:58.906980 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 15583
2026-08-07T22:41:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1085 ms)
[----------] 6 tests from EncryptionPolicyTest (11177 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:41:58 dist-test-slave-8w9v krb5kdc[16137](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:41:58 dist-test-slave-8w9v krb5kdc[16137](info): set up 2 sockets
Aug 07 22:41:58 dist-test-slave-8w9v krb5kdc[16137](info): commencing operation
krb5kdc: starting...
W20260807 22:41:59.983203 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:00 dist-test-slave-8w9v krb5kdc[16137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:00.111737 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36853
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:00.226035 16150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:00.226336 16150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:00.226397 16150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:00.230484 16150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:00.230543 16150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:00.230564 16150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:00.230581 16150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:00.230597 16150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:00.235891 16150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36853
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:00.237023 16150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:00.238090 16150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:00.246899 16155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:00.246893 16159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:00.246893 16157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:00.247093 16150 server_base.cc:1034] running on GCE node
I20260807 22:42:00.247794 16150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:00.248980 16150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:00.250174 16150 hybrid_clock.cc:648] HybridClock initialized: now 1786142520250143 us; error 40 us; skew 500 ppm
Aug 07 22:42:00 dist-test-slave-8w9v krb5kdc[16137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142520, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:00.258005 16150 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:00.259217 16150 webserver.cc:460] Webserver started at http://127.0.0.1:35799/ using document root <none> and password file <none>
I20260807 22:42:00.259861 16150 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:00.259930 16150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:00.260239 16150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:00.262473 16150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "45164ca0c5d340c8b5baa0d1664a6fbd"
format_stamp: "Formatted at 2026-08-07 22:42:00 on dist-test-slave-8w9v"
server_key: "67d92fbdb55ef93635a3364ac96f48b6"
server_key_iv: "2cc1c325d67c6de1752c14339cfc16e6"
server_key_version: "encryptionkey@0"
I20260807 22:42:00.263095 16150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "45164ca0c5d340c8b5baa0d1664a6fbd"
format_stamp: "Formatted at 2026-08-07 22:42:00 on dist-test-slave-8w9v"
server_key: "67d92fbdb55ef93635a3364ac96f48b6"
server_key_iv: "2cc1c325d67c6de1752c14339cfc16e6"
server_key_version: "encryptionkey@0"
I20260807 22:42:00.267283 16150 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 22:42:00.270035 16166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:00.271322 16150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:42:00.271486 16150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "45164ca0c5d340c8b5baa0d1664a6fbd"
format_stamp: "Formatted at 2026-08-07 22:42:00 on dist-test-slave-8w9v"
server_key: "67d92fbdb55ef93635a3364ac96f48b6"
server_key_iv: "2cc1c325d67c6de1752c14339cfc16e6"
server_key_version: "encryptionkey@0"
I20260807 22:42:00.271611 16150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:00.283192 16150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:00.286152 16150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:00.286374 16150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:00.294399 16150 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36853
I20260807 22:42:00.294425 16219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36853 every 8 connection(s)
I20260807 22:42:00.295701 16150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:00.298820 16220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:00.299197 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 16150
I20260807 22:42:00.299330 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:00.299674 26833 external_mini_cluster.cc:1428] Setting key 4df305979f74d31c1f891c60e345629c
I20260807 22:42:00.306128 16220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd: Bootstrap starting.
I20260807 22:42:00.309010 16220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd: Neither blocks nor log segments found. Creating new log.
Aug 07 22:42:00 dist-test-slave-8w9v krb5kdc[16137](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:42:00.309973 16220 log.cc:824] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:00.312491 16220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd: No bootstrap required, opened a new log
I20260807 22:42:00.315512 16223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:00.301146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55829 (local address 127.0.0.1:36853)
0807 22:42:00.301592 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:00.301616 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:00.301652 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:42:00.302323 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:00.302340 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:00.302684 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:00.302962 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:00.303912 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:00.305000 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:00.306172 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:00.306681 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:00.306804 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:00.309810 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:00.309815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:00.309828 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:00.309857 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:00.311892 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:00.312505 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:00.312514 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:00.312520 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:00.312659 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:00.313122 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:00.313142 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:00.313144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:00.313657 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:00.313859 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:00.314174 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 22:42:00.314409 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":137,"threads_started":1}
I20260807 22:42:00.317229 16220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45164ca0c5d340c8b5baa0d1664a6fbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } }
I20260807 22:42:00.317503 16220 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:00.317565 16220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45164ca0c5d340c8b5baa0d1664a6fbd, State: Initialized, Role: FOLLOWER
I20260807 22:42:00.318045 16220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45164ca0c5d340c8b5baa0d1664a6fbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } }
I20260807 22:42:00.318202 16220 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:00.318288 16220 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:00.318409 16220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:00.318863 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:00.319792 16220 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45164ca0c5d340c8b5baa0d1664a6fbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } }
I20260807 22:42:00.320096 16220 leader_election.cc:302] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45164ca0c5d340c8b5baa0d1664a6fbd; no voters:
I20260807 22:42:00.320485 16220 leader_election.cc:288] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:00.320567 16227 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:00.320775 16227 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [term 1 LEADER]: Becoming Leader. State: Replica: 45164ca0c5d340c8b5baa0d1664a6fbd, State: Running, Role: LEADER
I20260807 22:42:00.321076 16227 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45164ca0c5d340c8b5baa0d1664a6fbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } }
I20260807 22:42:00.321857 16220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:00.322732 16231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45164ca0c5d340c8b5baa0d1664a6fbd. Latest consensus state: current_term: 1 leader_uuid: "45164ca0c5d340c8b5baa0d1664a6fbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45164ca0c5d340c8b5baa0d1664a6fbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } } }
I20260807 22:42:00.322890 16231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:00.323210 16230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45164ca0c5d340c8b5baa0d1664a6fbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45164ca0c5d340c8b5baa0d1664a6fbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36853 } } }
I20260807 22:42:00.323311 16230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd [sys.catalog]: This master's current role is: LEADER
W20260807 22:42:00.327333 16247 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:42:00.327420 16247 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:00.327491 16239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:00.328524 16239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:00.331252 16223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:00.321460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56777 (local address 127.0.0.1:36853)
0807 22:42:00.321577 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:00.321581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:00.321837 (+ 256us) server_negotiation.cc:407] Connection header received
0807 22:42:00.322018 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:00.322021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:00.322070 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:00.322135 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:00.323151 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:00.323946 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:00.325066 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:00.325390 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:00.325507 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:00.327348 (+ 1841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:00.327355 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:00.327360 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:00.327386 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:00.329176 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:00.329826 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:00.329831 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:00.329832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:00.329915 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:00.330332 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:00.330336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:00.330337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:00.330568 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:00.330729 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:00.331009 (+ 280us) server_negotiation.cc:299] Negotiation successful
0807 22:42:00.331104 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:42:00.334661 16239 catalog_manager.cc:1347] Generated new cluster ID: 34e6fd59f7a44630b7620cea97572233
I20260807 22:42:00.334733 16239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:00.372602 16239 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:00.373962 16239 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:00.378489 16239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45164ca0c5d340c8b5baa0d1664a6fbd: Generated new TSK 0
I20260807 22:42:00.379211 16239 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:00.393177 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 16150
W20260807 22:42:00.401576 16135 connection.cc:535] client connection to 127.0.0.1:36853 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36853): Connection reset by peer (error 104)
2026-08-07T22:42:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1483 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:00 dist-test-slave-8w9v krb5kdc[16253](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:00 dist-test-slave-8w9v krb5kdc[16253](info): set up 2 sockets
Aug 07 22:42:00 dist-test-slave-8w9v krb5kdc[16253](info): commencing operation
krb5kdc: starting...
W20260807 22:42:01.475735 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:01 dist-test-slave-8w9v krb5kdc[16253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:01.611536 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43845
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:01.727911 16266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:01.728343 16266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:01.728440 16266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:01.732487 16266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:01.732592 16266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:01.732632 16266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:01.732672 16266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:01.732707 16266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:01.738355 16266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43845
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:01.739562 16266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:01.740703 16266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:01.751682 16271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:01.751623 16272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:01.751631 16275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:01.753060 16266 server_base.cc:1034] running on GCE node
I20260807 22:42:01.753837 16266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:01.755103 16266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:01.756309 16266 hybrid_clock.cc:648] HybridClock initialized: now 1786142521756294 us; error 27 us; skew 500 ppm
Aug 07 22:42:01 dist-test-slave-8w9v krb5kdc[16253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142521, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:01.759141 16266 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:01.760082 16266 webserver.cc:460] Webserver started at http://127.0.0.1:37715/ using document root <none> and password file <none>
I20260807 22:42:01.760694 16266 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:01.760795 16266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:01.761047 16266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:01.763155 16266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "c54bf64b80fc4b8ba8be00ca580bf79b"
format_stamp: "Formatted at 2026-08-07 22:42:01 on dist-test-slave-8w9v"
server_key: "6ed5c596651ef350309d296d406bf1b0"
server_key_iv: "9933e38089be14f0de8a969a872add49"
server_key_version: "encryptionkey@0"
I20260807 22:42:01.763739 16266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "c54bf64b80fc4b8ba8be00ca580bf79b"
format_stamp: "Formatted at 2026-08-07 22:42:01 on dist-test-slave-8w9v"
server_key: "6ed5c596651ef350309d296d406bf1b0"
server_key_iv: "9933e38089be14f0de8a969a872add49"
server_key_version: "encryptionkey@0"
I20260807 22:42:01.767637 16266 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260807 22:42:01.770216 16282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:01.771497 16266 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:42:01.771641 16266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "c54bf64b80fc4b8ba8be00ca580bf79b"
format_stamp: "Formatted at 2026-08-07 22:42:01 on dist-test-slave-8w9v"
server_key: "6ed5c596651ef350309d296d406bf1b0"
server_key_iv: "9933e38089be14f0de8a969a872add49"
server_key_version: "encryptionkey@0"
I20260807 22:42:01.771770 16266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:01.789100 16266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:01.792052 16266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:01.792300 16266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:01.799752 16266 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43845
I20260807 22:42:01.799772 16336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43845 every 8 connection(s)
I20260807 22:42:01.800843 16266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:01.803732 16337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:01.809417 16337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b: Bootstrap starting.
I20260807 22:42:01.809584 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 16266
I20260807 22:42:01.809749 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:01.810060 26833 external_mini_cluster.cc:1428] Setting key 44ffefbc4f34d97a1ab703476a41db9a
I20260807 22:42:01.812341 16337 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:01.813264 16337 log.cc:824] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:01.815623 16337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b: No bootstrap required, opened a new log
I20260807 22:42:01.820227 16337 raft_consensus.cc:348] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54bf64b80fc4b8ba8be00ca580bf79b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43845 } }
I20260807 22:42:01.820513 16337 raft_consensus.cc:374] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:01.820574 16337 raft_consensus.cc:729] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54bf64b80fc4b8ba8be00ca580bf79b, State: Initialized, Role: FOLLOWER
I20260807 22:42:01.820595 16340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:01.811514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40347 (local address 127.0.0.1:43845)
0807 22:42:01.811972 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:01.811992 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:01.812036 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:42:01.812961 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:01.812987 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:01.813431 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:01.813800 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:01.814224 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:01.815673 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:01.816688 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:01.817380 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:01.817549 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:01.818419 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:01.818427 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:01.818448 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:01.819045 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:01.819115 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:01.819147 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:01.819282 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:01.819436 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 22:42:01.819575 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":129,"threads_started":1}
I20260807 22:42:01.821060 16337 consensus_queue.cc:260] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54bf64b80fc4b8ba8be00ca580bf79b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43845 } }
I20260807 22:42:01.821235 16337 raft_consensus.cc:388] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:01.821316 16337 raft_consensus.cc:482] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:01.821452 16337 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:01.822378 16337 raft_consensus.cc:504] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54bf64b80fc4b8ba8be00ca580bf79b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43845 } }
I20260807 22:42:01.822736 16337 leader_election.cc:302] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c54bf64b80fc4b8ba8be00ca580bf79b; no voters:
I20260807 22:42:01.823082 16337 leader_election.cc:288] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:01.823158 16342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:01.823364 16342 raft_consensus.cc:686] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [term 1 LEADER]: Becoming Leader. State: Replica: c54bf64b80fc4b8ba8be00ca580bf79b, State: Running, Role: LEADER
I20260807 22:42:01.823647 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:01.823711 16342 consensus_queue.cc:237] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54bf64b80fc4b8ba8be00ca580bf79b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43845 } }
I20260807 22:42:01.824460 16337 sys_catalog.cc:564] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:01.825450 16343 sys_catalog.cc:455] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c54bf64b80fc4b8ba8be00ca580bf79b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54bf64b80fc4b8ba8be00ca580bf79b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43845 } } }
I20260807 22:42:01.825585 16343 sys_catalog.cc:458] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:01.825918 16344 sys_catalog.cc:455] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c54bf64b80fc4b8ba8be00ca580bf79b. Latest consensus state: current_term: 1 leader_uuid: "c54bf64b80fc4b8ba8be00ca580bf79b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c54bf64b80fc4b8ba8be00ca580bf79b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43845 } } }
I20260807 22:42:01.825994 16344 sys_catalog.cc:458] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:01.826014 16356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:01.829663 16356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:01.832386 16340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:01.826991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33573 (local address 127.0.0.1:43845)
0807 22:42:01.827125 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:01.827130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:01.827396 (+ 266us) server_negotiation.cc:407] Connection header received
0807 22:42:01.827617 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:01.827621 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:01.827677 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:01.827732 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:01.828203 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:01.829017 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:01.830181 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:01.830521 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:01.830600 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:01.831822 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:01.831825 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:01.831828 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:01.831842 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:01.831873 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:01.831886 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:01.831998 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:01.832210 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 22:42:01.832248 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 22:42:01.835975 16356 catalog_manager.cc:1347] Generated new cluster ID: 1f4455565a82436f93ed7bf5657c8160
I20260807 22:42:01.836059 16356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:01.842115 16356 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:01.843003 16356 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:01.850677 16356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c54bf64b80fc4b8ba8be00ca580bf79b: Generated new TSK 0
I20260807 22:42:01.851383 16356 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:01.859261 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 16266
W20260807 22:42:01.869122 16251 connection.cc:535] client connection to 127.0.0.1:43845 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43845): Connection reset by peer (error 104)
2026-08-07T22:42:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1467 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:01 dist-test-slave-8w9v krb5kdc[16369](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:01 dist-test-slave-8w9v krb5kdc[16369](info): set up 2 sockets
Aug 07 22:42:01 dist-test-slave-8w9v krb5kdc[16369](info): commencing operation
krb5kdc: starting...
W20260807 22:42:02.946807 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:03 dist-test-slave-8w9v krb5kdc[16369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:03.083885 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34771
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:03.197126 16382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:03.197470 16382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:03.197547 16382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:03.201586 16382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:03.201689 16382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:03.201730 16382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:03.201788 16382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:03.201824 16382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:03.207230 16382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34771
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:03.208437 16382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:03.209513 16382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:42:03.218604 16382 server_base.cc:1034] running on GCE node
W20260807 22:42:03.218578 16391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:03.218550 16389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:03.218550 16388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:03.219462 16382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:03.220695 16382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:03.221884 16382 hybrid_clock.cc:648] HybridClock initialized: now 1786142523221852 us; error 47 us; skew 500 ppm
Aug 07 22:42:03 dist-test-slave-8w9v krb5kdc[16369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142523, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:03.229264 16382 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:03.230266 16382 webserver.cc:460] Webserver started at http://127.0.0.1:38625/ using document root <none> and password file <none>
I20260807 22:42:03.230887 16382 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:03.230958 16382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:03.231137 16382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:03.233304 16382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "32eb6e3397554761b9ae7b0297a0669a"
format_stamp: "Formatted at 2026-08-07 22:42:03 on dist-test-slave-8w9v"
server_key: "69fc8410645606f5d71d2c05e08c0546"
server_key_iv: "536e66599ec55a7b0b23fda5dcf5e4da"
server_key_version: "encryptionkey@0"
I20260807 22:42:03.233846 16382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "32eb6e3397554761b9ae7b0297a0669a"
format_stamp: "Formatted at 2026-08-07 22:42:03 on dist-test-slave-8w9v"
server_key: "69fc8410645606f5d71d2c05e08c0546"
server_key_iv: "536e66599ec55a7b0b23fda5dcf5e4da"
server_key_version: "encryptionkey@0"
I20260807 22:42:03.237798 16382 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:42:03.240350 16398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:03.241612 16382 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:42:03.241768 16382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "32eb6e3397554761b9ae7b0297a0669a"
format_stamp: "Formatted at 2026-08-07 22:42:03 on dist-test-slave-8w9v"
server_key: "69fc8410645606f5d71d2c05e08c0546"
server_key_iv: "536e66599ec55a7b0b23fda5dcf5e4da"
server_key_version: "encryptionkey@0"
I20260807 22:42:03.241889 16382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:03.246747 16382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:03.250202 16382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:03.250412 16382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:03.258111 16382 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34771
I20260807 22:42:03.258137 16453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34771 every 8 connection(s)
I20260807 22:42:03.259153 16382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:03.261016 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 16382
I20260807 22:42:03.261161 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:03.261464 26833 external_mini_cluster.cc:1428] Setting key 43d6ae3a4e7c2cdffd37062fcaa62f6c
I20260807 22:42:03.262332 16454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:03.267412 16457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:03.262974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46911 (local address 127.0.0.1:34771)
0807 22:42:03.263419 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:03.263449 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:03.263493 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:42:03.264387 (+ 894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:03.264412 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:03.264786 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:03.265167 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:03.265898 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:03.265904 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:03.265921 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:03.265934 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:03.266001 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:03.266028 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:03.266189 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:03.266300 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 22:42:03.266469 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":114,"threads_started":1}
I20260807 22:42:03.269644 16454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a: Bootstrap starting.
I20260807 22:42:03.270666 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:03.272593 16454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:03.273548 16454 log.cc:824] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:03.274999 16457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:03.273125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37351 (local address 127.0.0.1:34771)
0807 22:42:03.273268 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:03.273273 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:03.273509 (+ 236us) server_negotiation.cc:407] Connection header received
0807 22:42:03.273670 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:03.273674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:03.273725 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:03.273793 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:03.274605 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:03.274608 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:03.274610 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:03.274620 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:03.274643 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:03.274653 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:03.274722 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:03.274827 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 22:42:03.274859 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:42:03.276271 16454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a: No bootstrap required, opened a new log
I20260807 22:42:03.279954 16454 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eb6e3397554761b9ae7b0297a0669a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34771 } }
I20260807 22:42:03.280270 16454 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:03.280347 16454 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32eb6e3397554761b9ae7b0297a0669a, State: Initialized, Role: FOLLOWER
I20260807 22:42:03.280836 16454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eb6e3397554761b9ae7b0297a0669a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34771 } }
I20260807 22:42:03.281028 16454 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:03.281108 16454 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:03.281206 16454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:03.282209 16454 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eb6e3397554761b9ae7b0297a0669a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34771 } }
I20260807 22:42:03.282510 16454 leader_election.cc:302] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32eb6e3397554761b9ae7b0297a0669a; no voters:
I20260807 22:42:03.282817 16454 leader_election.cc:288] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:03.282981 16464 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:03.283236 16464 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [term 1 LEADER]: Becoming Leader. State: Replica: 32eb6e3397554761b9ae7b0297a0669a, State: Running, Role: LEADER
I20260807 22:42:03.283610 16464 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eb6e3397554761b9ae7b0297a0669a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34771 } }
I20260807 22:42:03.284215 16454 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:03.285547 16465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32eb6e3397554761b9ae7b0297a0669a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eb6e3397554761b9ae7b0297a0669a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34771 } } }
I20260807 22:42:03.285564 16466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32eb6e3397554761b9ae7b0297a0669a. Latest consensus state: current_term: 1 leader_uuid: "32eb6e3397554761b9ae7b0297a0669a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eb6e3397554761b9ae7b0297a0669a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34771 } } }
I20260807 22:42:03.285749 16465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:03.285784 16466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a [sys.catalog]: This master's current role is: LEADER
W20260807 22:42:03.289225 16480 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:42:03.289312 16480 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:03.289397 16477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:03.290098 16477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:03.296329 16477 catalog_manager.cc:1347] Generated new cluster ID: 11b9dcdcfeaf411fab64f199073bc3c3
I20260807 22:42:03.296430 16477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:03.314373 16477 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:03.314739 16477 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:03.320722 16477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32eb6e3397554761b9ae7b0297a0669a: Generated new TSK 0
I20260807 22:42:03.321532 16477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:03.330442 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 16382
2026-08-07T22:42:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1469 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:03 dist-test-slave-8w9v krb5kdc[16486](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:03 dist-test-slave-8w9v krb5kdc[16486](info): set up 2 sockets
Aug 07 22:42:03 dist-test-slave-8w9v krb5kdc[16486](info): commencing operation
krb5kdc: starting...
W20260807 22:42:04.427556 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:04 dist-test-slave-8w9v krb5kdc[16486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:04.557492 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42299
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:04.673555 16499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:04.673900 16499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:04.673990 16499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:04.678138 16499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:04.678267 16499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:04.678309 16499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:04.678363 16499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:04.678401 16499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:04.683957 16499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:04.685295 16499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:04.686404 16499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:04.695406 16504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:04.695415 16505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:04.695415 16507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:04.695657 16499 server_base.cc:1034] running on GCE node
I20260807 22:42:04.696350 16499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:04.697430 16499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:04.698627 16499 hybrid_clock.cc:648] HybridClock initialized: now 1786142524698615 us; error 24 us; skew 500 ppm
Aug 07 22:42:04 dist-test-slave-8w9v krb5kdc[16486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142524, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:04.701877 16499 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:04.702721 16499 webserver.cc:460] Webserver started at http://127.0.0.1:42559/ using document root <none> and password file <none>
I20260807 22:42:04.703284 16499 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:04.703342 16499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:04.703512 16499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:04.705597 16499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "ec84fb8c4e44408bae5689ba17704390"
format_stamp: "Formatted at 2026-08-07 22:42:04 on dist-test-slave-8w9v"
server_key: "c463e0616f7bd19273ec7bde7939ccad"
server_key_iv: "c1cb35e7416963c1e708407f0f3f99ee"
server_key_version: "encryptionkey@0"
I20260807 22:42:04.706123 16499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "ec84fb8c4e44408bae5689ba17704390"
format_stamp: "Formatted at 2026-08-07 22:42:04 on dist-test-slave-8w9v"
server_key: "c463e0616f7bd19273ec7bde7939ccad"
server_key_iv: "c1cb35e7416963c1e708407f0f3f99ee"
server_key_version: "encryptionkey@0"
I20260807 22:42:04.709883 16499 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260807 22:42:04.712347 16514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:04.713608 16499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 22:42:04.713711 16499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "ec84fb8c4e44408bae5689ba17704390"
format_stamp: "Formatted at 2026-08-07 22:42:04 on dist-test-slave-8w9v"
server_key: "c463e0616f7bd19273ec7bde7939ccad"
server_key_iv: "c1cb35e7416963c1e708407f0f3f99ee"
server_key_version: "encryptionkey@0"
I20260807 22:42:04.713799 16499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:04.736334 16499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:04.739346 16499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:04.739516 16499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:04.747032 16499 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42299
I20260807 22:42:04.747138 16568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42299 every 8 connection(s)
I20260807 22:42:04.748109 16499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:04.751050 16569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:04.755188 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 16499
I20260807 22:42:04.755357 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:04.755651 26833 external_mini_cluster.cc:1428] Setting key ee49ca4b4551fbb859c651f45313e687
I20260807 22:42:04.757280 16569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390: Bootstrap starting.
I20260807 22:42:04.759768 16569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:04.760639 16569 log.cc:824] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:04.762863 16569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390: No bootstrap required, opened a new log
Aug 07 22:42:04 dist-test-slave-8w9v krb5kdc[16486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:42:04.767930 16569 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec84fb8c4e44408bae5689ba17704390" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } }
I20260807 22:42:04.768270 16569 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:04.768314 16569 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec84fb8c4e44408bae5689ba17704390, State: Initialized, Role: FOLLOWER
I20260807 22:42:04.768846 16569 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec84fb8c4e44408bae5689ba17704390" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } }
I20260807 22:42:04.769040 16569 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:04.769119 16569 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:04.769224 16569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:04.770502 16569 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec84fb8c4e44408bae5689ba17704390" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } }
I20260807 22:42:04.770876 16569 leader_election.cc:302] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec84fb8c4e44408bae5689ba17704390; no voters:
I20260807 22:42:04.771278 16569 leader_election.cc:288] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:04.771428 16574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:04.771674 16574 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [term 1 LEADER]: Becoming Leader. State: Replica: ec84fb8c4e44408bae5689ba17704390, State: Running, Role: LEADER
I20260807 22:42:04.771730 16572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:04.757227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40311 (local address 127.0.0.1:42299)
0807 22:42:04.757697 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:04.757713 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:04.757750 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:42:04.758386 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:04.758402 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:04.758738 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:04.759023 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:04.760004 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:04.761162 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:04.762369 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:04.762828 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:04.762980 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:04.765864 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:04.765873 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:04.765894 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:04.765935 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:04.768025 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:04.768761 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:04.768767 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:04.768773 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:04.768923 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:04.769277 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:04.769281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:04.769283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:04.769828 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:04.770038 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:04.770274 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 22:42:04.770623 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":179,"threads_started":1}
I20260807 22:42:04.772073 16574 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec84fb8c4e44408bae5689ba17704390" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } }
I20260807 22:42:04.772658 16569 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:04.774058 16575 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec84fb8c4e44408bae5689ba17704390" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec84fb8c4e44408bae5689ba17704390" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } } }
I20260807 22:42:04.774187 16575 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:04.774471 16576 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec84fb8c4e44408bae5689ba17704390. Latest consensus state: current_term: 1 leader_uuid: "ec84fb8c4e44408bae5689ba17704390" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec84fb8c4e44408bae5689ba17704390" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } } }
I20260807 22:42:04.774596 16576 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:04.775120 16582 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:04.775480 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:04.778579 16582 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:04.784600 16582 catalog_manager.cc:1347] Generated new cluster ID: aaac794003e6450cada6e2824837e5b9
I20260807 22:42:04.784677 16582 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:04.792464 16572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:04.777893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58325 (local address 127.0.0.1:42299)
0807 22:42:04.778012 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:04.778016 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:04.784480 (+ 6464us) server_negotiation.cc:407] Connection header received
0807 22:42:04.784637 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:04.784641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:04.784697 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:04.784818 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:04.785889 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:04.786456 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:04.787316 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:04.787565 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:04.787679 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:04.789182 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:04.789186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:04.789189 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:04.789221 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:04.790688 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:04.791121 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:04.791125 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:04.791127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:04.791211 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:04.791504 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:04.791508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:04.791510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:04.791719 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:04.791860 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:04.792100 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 22:42:04.792269 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":46}
I20260807 22:42:04.818944 16582 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:04.820501 16582 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:04.826264 16582 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec84fb8c4e44408bae5689ba17704390: Generated new TSK 0
I20260807 22:42:04.827111 16582 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:04.839442 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 16499
2026-08-07T22:42:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1510 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:04 dist-test-slave-8w9v krb5kdc[16600](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:04 dist-test-slave-8w9v krb5kdc[16600](info): set up 2 sockets
Aug 07 22:42:04 dist-test-slave-8w9v krb5kdc[16600](info): commencing operation
krb5kdc: starting...
W20260807 22:42:05.923269 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:06 dist-test-slave-8w9v krb5kdc[16600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:06.054973 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42305
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:06.170518 16615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:06.170840 16615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:06.170914 16615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:06.175019 16615 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:06.175122 16615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:06.175163 16615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:06.175221 16615 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:06.175258 16615 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:06.180842 16615 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:06.182025 16615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:06.183144 16615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:06.192505 16622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:06.192505 16624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:06.192523 16621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:06.192793 16615 server_base.cc:1034] running on GCE node
I20260807 22:42:06.193552 16615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:06.194800 16615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:06.196017 16615 hybrid_clock.cc:648] HybridClock initialized: now 1786142526196008 us; error 34 us; skew 500 ppm
Aug 07 22:42:06 dist-test-slave-8w9v krb5kdc[16600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142526, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:06.202528 16615 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:06.203600 16615 webserver.cc:460] Webserver started at http://127.0.0.1:36839/ using document root <none> and password file <none>
I20260807 22:42:06.204286 16615 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:06.204385 16615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:06.204644 16615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:06.206797 16615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "242f3e38200d4619a9cf482227c3a1d5"
format_stamp: "Formatted at 2026-08-07 22:42:06 on dist-test-slave-8w9v"
server_key: "aa1193f542bd0140619ea1d06e0104d8"
server_key_iv: "b152283f419daae619e69ad050e92816"
server_key_version: "encryptionkey@0"
I20260807 22:42:06.207432 16615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "242f3e38200d4619a9cf482227c3a1d5"
format_stamp: "Formatted at 2026-08-07 22:42:06 on dist-test-slave-8w9v"
server_key: "aa1193f542bd0140619ea1d06e0104d8"
server_key_iv: "b152283f419daae619e69ad050e92816"
server_key_version: "encryptionkey@0"
I20260807 22:42:06.211359 16615 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 22:42:06.214031 16631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:06.215345 16615 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 22:42:06.215508 16615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "242f3e38200d4619a9cf482227c3a1d5"
format_stamp: "Formatted at 2026-08-07 22:42:06 on dist-test-slave-8w9v"
server_key: "aa1193f542bd0140619ea1d06e0104d8"
server_key_iv: "b152283f419daae619e69ad050e92816"
server_key_version: "encryptionkey@0"
I20260807 22:42:06.215631 16615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:06.234304 16615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:06.238031 16615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:06.238268 16615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:06.246186 16615 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42305
I20260807 22:42:06.246213 16686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42305 every 8 connection(s)
I20260807 22:42:06.247231 16615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:06.250170 16687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:06.252758 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 16615
I20260807 22:42:06.252923 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:06.253264 26833 external_mini_cluster.cc:1428] Setting key 803bb9df68972b6a4bb48bfa442b2ef2
I20260807 22:42:06.256871 16687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5: Bootstrap starting.
I20260807 22:42:06.259215 16687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:06.259990 16687 log.cc:824] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:06.262090 16687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5: No bootstrap required, opened a new log
I20260807 22:42:06.262558 16690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:06.254838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40265 (local address 127.0.0.1:42305)
0807 22:42:06.255318 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:06.255334 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:06.255371 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:42:06.256054 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:06.256071 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:06.256487 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:06.256827 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:06.257247 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:06.258210 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:06.259146 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:06.259696 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:06.259878 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:06.260803 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:06.260808 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:06.260821 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:06.261222 (+ 401us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:06.261281 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:06.261304 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:06.261418 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:06.261550 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 22:42:06.261774 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":155,"threads_started":1}
I20260807 22:42:06.265580 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:06.266326 16687 raft_consensus.cc:348] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242f3e38200d4619a9cf482227c3a1d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42305 } }
I20260807 22:42:06.266595 16687 raft_consensus.cc:374] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:06.266675 16687 raft_consensus.cc:729] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242f3e38200d4619a9cf482227c3a1d5, State: Initialized, Role: FOLLOWER
I20260807 22:42:06.267160 16687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242f3e38200d4619a9cf482227c3a1d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42305 } }
I20260807 22:42:06.267323 16687 raft_consensus.cc:388] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:06.267413 16687 raft_consensus.cc:482] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:06.267546 16687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:06.268922 16687 raft_consensus.cc:504] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242f3e38200d4619a9cf482227c3a1d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42305 } }
I20260807 22:42:06.269316 16687 leader_election.cc:302] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 242f3e38200d4619a9cf482227c3a1d5; no voters:
I20260807 22:42:06.269711 16687 leader_election.cc:288] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:06.269796 16697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:06.270008 16697 raft_consensus.cc:686] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [term 1 LEADER]: Becoming Leader. State: Replica: 242f3e38200d4619a9cf482227c3a1d5, State: Running, Role: LEADER
I20260807 22:42:06.270376 16697 consensus_queue.cc:237] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242f3e38200d4619a9cf482227c3a1d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42305 } }
I20260807 22:42:06.271147 16687 sys_catalog.cc:564] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:06.271654 16697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 242f3e38200d4619a9cf482227c3a1d5. Latest consensus state: current_term: 1 leader_uuid: "242f3e38200d4619a9cf482227c3a1d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242f3e38200d4619a9cf482227c3a1d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42305 } } }
I20260807 22:42:06.271828 16697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:06.272332 16703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:06.272516 16690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:06.267705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51733 (local address 127.0.0.1:42305)
0807 22:42:06.267858 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:06.267863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:06.268041 (+ 178us) server_negotiation.cc:407] Connection header received
0807 22:42:06.268154 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:06.268157 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:06.268209 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:06.268297 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:06.268575 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:06.269361 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:06.270414 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:06.270712 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:06.270826 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:06.271739 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:06.271744 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:06.271749 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:06.271766 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:06.271802 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:06.271819 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:06.271896 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:06.272300 (+ 404us) server_negotiation.cc:299] Negotiation successful
0807 22:42:06.272368 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:42:06.272194 16698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "242f3e38200d4619a9cf482227c3a1d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242f3e38200d4619a9cf482227c3a1d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42305 } } }
I20260807 22:42:06.274971 16698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:06.275710 16703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:06.282582 16703 catalog_manager.cc:1347] Generated new cluster ID: 960116757aac4dddb100574896002055
I20260807 22:42:06.282677 16703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:06.307655 16703 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:06.308746 16703 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:06.315104 16703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 242f3e38200d4619a9cf482227c3a1d5: Generated new TSK 0
I20260807 22:42:06.315889 16703 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:06.323550 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 16615
2026-08-07T22:42:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1483 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:06 dist-test-slave-8w9v krb5kdc[16720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:06 dist-test-slave-8w9v krb5kdc[16720](info): set up 2 sockets
Aug 07 22:42:06 dist-test-slave-8w9v krb5kdc[16720](info): commencing operation
krb5kdc: starting...
W20260807 22:42:07.412104 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:07 dist-test-slave-8w9v krb5kdc[16720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142527, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:07.543207 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33445
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:07.658227 16733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:07.658528 16733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:07.658571 16733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:07.662751 16733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:07.662820 16733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:07.662840 16733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:07.662887 16733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:07.662928 16733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:07.668422 16733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:07.669544 16733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:07.670661 16733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:07.679739 16738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:07.679847 16733 server_base.cc:1034] running on GCE node
W20260807 22:42:07.679721 16739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:07.679721 16741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:07.680606 16733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:07.681753 16733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:07.682921 16733 hybrid_clock.cc:648] HybridClock initialized: now 1786142527682893 us; error 43 us; skew 500 ppm
Aug 07 22:42:07 dist-test-slave-8w9v krb5kdc[16720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142527, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:07.685845 16733 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:07.686789 16733 webserver.cc:460] Webserver started at http://127.0.0.1:43633/ using document root <none> and password file <none>
I20260807 22:42:07.687381 16733 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:07.687445 16733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:07.687668 16733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:07.689852 16733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "7de90032bacd437aa8b3455a9a234de9"
format_stamp: "Formatted at 2026-08-07 22:42:07 on dist-test-slave-8w9v"
server_key: "6b2f458a794612aaa547978f605ced2b"
server_key_iv: "fafdd47f8e11e45abfa2de0ad7f1e20d"
server_key_version: "encryptionkey@0"
I20260807 22:42:07.690434 16733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "7de90032bacd437aa8b3455a9a234de9"
format_stamp: "Formatted at 2026-08-07 22:42:07 on dist-test-slave-8w9v"
server_key: "6b2f458a794612aaa547978f605ced2b"
server_key_iv: "fafdd47f8e11e45abfa2de0ad7f1e20d"
server_key_version: "encryptionkey@0"
I20260807 22:42:07.694378 16733 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 22:42:07.696866 16748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:07.698125 16733 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:42:07.698266 16733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "7de90032bacd437aa8b3455a9a234de9"
format_stamp: "Formatted at 2026-08-07 22:42:07 on dist-test-slave-8w9v"
server_key: "6b2f458a794612aaa547978f605ced2b"
server_key_iv: "fafdd47f8e11e45abfa2de0ad7f1e20d"
server_key_version: "encryptionkey@0"
I20260807 22:42:07.698381 16733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:07.703433 16733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:07.706640 16733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:07.706887 16733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:07.714833 16733 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33445
I20260807 22:42:07.714890 16804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33445 every 8 connection(s)
I20260807 22:42:07.715860 16733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:07.718905 16805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:07.720448 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 16733
I20260807 22:42:07.720603 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:07.720917 26833 external_mini_cluster.cc:1428] Setting key 41056fa0536c38808f6dbda54a76c701
I20260807 22:42:07.725659 16805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9: Bootstrap starting.
I20260807 22:42:07.726318 16808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.722321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58927 (local address 127.0.0.1:33445)
0807 22:42:07.722739 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.722755 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.722792 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:42:07.723421 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.723438 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.723709 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.723991 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:07.724914 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:07.724919 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:07.724930 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:07.724940 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:07.724994 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:07.725013 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:07.725132 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.725280 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.725467 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":137,"threads_started":1}
I20260807 22:42:07.728250 16805 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:07.729162 16805 log.cc:824] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:07.729408 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:07.731359 16805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9: No bootstrap required, opened a new log
I20260807 22:42:07.733320 16808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.731486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33721 (local address 127.0.0.1:33445)
0807 22:42:07.731619 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.731624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.731817 (+ 193us) server_negotiation.cc:407] Connection header received
0807 22:42:07.731897 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.731900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.731942 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.732029 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:07.732803 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:07.732807 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:07.732810 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:07.732821 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:07.732850 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:07.732865 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:07.732964 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.733132 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.733186 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:42:07.735793 16805 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de90032bacd437aa8b3455a9a234de9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33445 } }
I20260807 22:42:07.736049 16805 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:07.736124 16805 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de90032bacd437aa8b3455a9a234de9, State: Initialized, Role: FOLLOWER
I20260807 22:42:07.736581 16805 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de90032bacd437aa8b3455a9a234de9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33445 } }
I20260807 22:42:07.736729 16805 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:07.736797 16805 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:07.736920 16805 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:07.737895 16805 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de90032bacd437aa8b3455a9a234de9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33445 } }
I20260807 22:42:07.738257 16805 leader_election.cc:302] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7de90032bacd437aa8b3455a9a234de9; no voters:
I20260807 22:42:07.738606 16805 leader_election.cc:288] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:07.738729 16815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:07.739001 16815 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [term 1 LEADER]: Becoming Leader. State: Replica: 7de90032bacd437aa8b3455a9a234de9, State: Running, Role: LEADER
I20260807 22:42:07.739352 16815 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de90032bacd437aa8b3455a9a234de9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33445 } }
I20260807 22:42:07.739997 16805 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:07.741313 16817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7de90032bacd437aa8b3455a9a234de9. Latest consensus state: current_term: 1 leader_uuid: "7de90032bacd437aa8b3455a9a234de9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de90032bacd437aa8b3455a9a234de9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33445 } } }
I20260807 22:42:07.741329 16816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7de90032bacd437aa8b3455a9a234de9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de90032bacd437aa8b3455a9a234de9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33445 } } }
I20260807 22:42:07.741498 16817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:07.741505 16816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:07.741954 16825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:07.745831 16825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:07.754031 16825 catalog_manager.cc:1347] Generated new cluster ID: 3829c29c8bcd4598b046bb610a1e6db0
I20260807 22:42:07.754168 16825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:07.772218 16825 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:07.772588 16825 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:07.780689 16825 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7de90032bacd437aa8b3455a9a234de9: Generated new TSK 0
I20260807 22:42:07.781414 16825 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:07.792285 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 16733
2026-08-07T22:42:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1468 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:07 dist-test-slave-8w9v krb5kdc[16836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:07 dist-test-slave-8w9v krb5kdc[16836](info): set up 2 sockets
Aug 07 22:42:07 dist-test-slave-8w9v krb5kdc[16836](info): commencing operation
krb5kdc: starting...
W20260807 22:42:08.878762 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:08 dist-test-slave-8w9v krb5kdc[16836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:09.012331 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34005
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:09.127825 16850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:09.128160 16850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:09.128206 16850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:09.133072 16850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:09.133158 16850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:09.133179 16850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:09.133196 16850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:09.133213 16850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:09.138871 16850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34005
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:09.140053 16850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:09.141126 16850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:09.150327 16859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:09.150331 16856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:09.150357 16855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:09.150651 16850 server_base.cc:1034] running on GCE node
I20260807 22:42:09.151239 16850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:09.152462 16850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:09.153653 16850 hybrid_clock.cc:648] HybridClock initialized: now 1786142529153635 us; error 32 us; skew 500 ppm
Aug 07 22:42:09 dist-test-slave-8w9v krb5kdc[16836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142529, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:09.156858 16850 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:09.157809 16850 webserver.cc:460] Webserver started at http://127.0.0.1:42053/ using document root <none> and password file <none>
I20260807 22:42:09.158416 16850 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:09.158507 16850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:09.158738 16850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:09.160959 16850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "3804fc851cf74ae08f710c375c92388d"
format_stamp: "Formatted at 2026-08-07 22:42:09 on dist-test-slave-8w9v"
server_key: "167556d221de98b8c6206964015d5240"
server_key_iv: "297b247cd5c5c11551e3261e1ab1e569"
server_key_version: "encryptionkey@0"
I20260807 22:42:09.161546 16850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "3804fc851cf74ae08f710c375c92388d"
format_stamp: "Formatted at 2026-08-07 22:42:09 on dist-test-slave-8w9v"
server_key: "167556d221de98b8c6206964015d5240"
server_key_iv: "297b247cd5c5c11551e3261e1ab1e569"
server_key_version: "encryptionkey@0"
I20260807 22:42:09.165444 16850 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:42:09.167968 16866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:09.169263 16850 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:42:09.169437 16850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "3804fc851cf74ae08f710c375c92388d"
format_stamp: "Formatted at 2026-08-07 22:42:09 on dist-test-slave-8w9v"
server_key: "167556d221de98b8c6206964015d5240"
server_key_iv: "297b247cd5c5c11551e3261e1ab1e569"
server_key_version: "encryptionkey@0"
I20260807 22:42:09.169564 16850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:09.198730 16850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:09.201946 16850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:09.202172 16850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:09.209769 16850 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34005
I20260807 22:42:09.209794 16921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34005 every 8 connection(s)
I20260807 22:42:09.210807 16850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:09.213809 16922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:09.219873 16922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d: Bootstrap starting.
I20260807 22:42:09.220775 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 16850
I20260807 22:42:09.220937 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:09.221274 26833 external_mini_cluster.cc:1428] Setting key 3c5f7cf80bf4b292ec0a434e2b77786a
I20260807 22:42:09.223162 16922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:09.224045 16922 log.cc:824] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:09.226431 16922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d: No bootstrap required, opened a new log
Aug 07 22:42:09 dist-test-slave-8w9v krb5kdc[16836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:42:09.231213 16922 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3804fc851cf74ae08f710c375c92388d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34005 } }
I20260807 22:42:09.231477 16922 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:09.231570 16922 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3804fc851cf74ae08f710c375c92388d, State: Initialized, Role: FOLLOWER
I20260807 22:42:09.232097 16922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3804fc851cf74ae08f710c375c92388d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34005 } }
I20260807 22:42:09.232306 16922 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:09.232401 16922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:09.232504 16922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:09.233458 16922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3804fc851cf74ae08f710c375c92388d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34005 } }
I20260807 22:42:09.233839 16922 leader_election.cc:302] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3804fc851cf74ae08f710c375c92388d; no voters:
I20260807 22:42:09.234206 16922 leader_election.cc:288] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:09.234283 16927 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:09.234503 16927 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [term 1 LEADER]: Becoming Leader. State: Replica: 3804fc851cf74ae08f710c375c92388d, State: Running, Role: LEADER
I20260807 22:42:09.234827 16927 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3804fc851cf74ae08f710c375c92388d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34005 } }
I20260807 22:42:09.235653 16922 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:09.236145 16927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3804fc851cf74ae08f710c375c92388d. Latest consensus state: current_term: 1 leader_uuid: "3804fc851cf74ae08f710c375c92388d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3804fc851cf74ae08f710c375c92388d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34005 } } }
I20260807 22:42:09.236269 16927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:09.236482 16927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3804fc851cf74ae08f710c375c92388d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3804fc851cf74ae08f710c375c92388d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34005 } } }
I20260807 22:42:09.236582 16927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:09.236938 16932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:09.237277 16925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:09.222614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:51641 (local address 127.0.0.1:34005)
0807 22:42:09.223102 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:09.223117 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:09.223153 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:42:09.223870 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:09.223888 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:09.224344 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:09.224732 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:09.225703 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:09.226737 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:09.227889 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:09.228417 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:09.228541 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:09.231552 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:09.231559 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:09.231578 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:09.231617 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:09.233576 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:09.234203 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:09.234210 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:09.234216 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:09.234393 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:09.234788 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:09.234791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:09.234793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:09.235266 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:09.235501 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:09.235847 (+ 346us) server_negotiation.cc:299] Negotiation successful
0807 22:42:09.236178 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":149,"threads_started":1}
I20260807 22:42:09.240500 16932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:09.241302 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:09.246688 16932 catalog_manager.cc:1347] Generated new cluster ID: b454c574f2e447ad9228228734708e28
I20260807 22:42:09.246776 16932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:09.253206 16925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:09.244261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:42521 (local address 127.0.0.1:34005)
0807 22:42:09.244377 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:09.244381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:09.244393 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:42:09.244424 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:09.244426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:09.244463 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:09.244564 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:09.245424 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:09.245961 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:09.247131 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:09.247507 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:09.247625 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:09.249339 (+ 1714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:09.249344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:09.249347 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:09.249376 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:09.251196 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:09.251735 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:09.251739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:09.251741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:09.251834 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:09.252224 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:09.252228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:09.252230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:09.252476 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:09.252636 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:09.252919 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 22:42:09.253029 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:42:09.256412 16932 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:09.257406 16932 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:09.267107 16932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3804fc851cf74ae08f710c375c92388d: Generated new TSK 0
I20260807 22:42:09.267921 16932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:09.275221 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 16850
W20260807 22:42:09.284080 16834 connection.cc:535] client connection to 127.0.0.1:34005 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34005): Connection reset by peer (error 104)
2026-08-07T22:42:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1484 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:09 dist-test-slave-8w9v krb5kdc[16954](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:09 dist-test-slave-8w9v krb5kdc[16954](info): set up 2 sockets
Aug 07 22:42:09 dist-test-slave-8w9v krb5kdc[16954](info): commencing operation
krb5kdc: starting...
W20260807 22:42:10.344436 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:10 dist-test-slave-8w9v krb5kdc[16954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:10.479422 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37641
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:10.594973 16967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:10.595268 16967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:10.595310 16967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:10.599535 16967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:10.599617 16967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:10.599637 16967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:10.599653 16967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:10.599668 16967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:10.605293 16967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:10.606490 16967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:10.607579 16967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:10.617419 16973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:10.617480 16972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:10.617480 16975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:10.617837 16967 server_base.cc:1034] running on GCE node
I20260807 22:42:10.618475 16967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:10.619678 16967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:10.620880 16967 hybrid_clock.cc:648] HybridClock initialized: now 1786142530620854 us; error 40 us; skew 500 ppm
Aug 07 22:42:10 dist-test-slave-8w9v krb5kdc[16954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142530, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:10.623791 16967 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:10.624836 16967 webserver.cc:460] Webserver started at http://127.0.0.1:40523/ using document root <none> and password file <none>
I20260807 22:42:10.625456 16967 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:10.625554 16967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:10.625803 16967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:10.628039 16967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5"
format_stamp: "Formatted at 2026-08-07 22:42:10 on dist-test-slave-8w9v"
server_key: "5f2a9d9fca0440193c3c83a47de1d4c1"
server_key_iv: "83391f5e171659145f701b1c18329c61"
server_key_version: "encryptionkey@0"
I20260807 22:42:10.628708 16967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5"
format_stamp: "Formatted at 2026-08-07 22:42:10 on dist-test-slave-8w9v"
server_key: "5f2a9d9fca0440193c3c83a47de1d4c1"
server_key_iv: "83391f5e171659145f701b1c18329c61"
server_key_version: "encryptionkey@0"
I20260807 22:42:10.632654 16967 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:42:10.635172 16983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:10.636554 16967 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:42:10.636714 16967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5"
format_stamp: "Formatted at 2026-08-07 22:42:10 on dist-test-slave-8w9v"
server_key: "5f2a9d9fca0440193c3c83a47de1d4c1"
server_key_iv: "83391f5e171659145f701b1c18329c61"
server_key_version: "encryptionkey@0"
I20260807 22:42:10.636843 16967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:10.670562 16967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:10.673676 16967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:10.673902 16967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:10.681452 16967 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37641
I20260807 22:42:10.681493 17036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37641 every 8 connection(s)
I20260807 22:42:10.682469 16967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:10.685307 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:10.687317 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 16967
I20260807 22:42:10.687465 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:10.687783 26833 external_mini_cluster.cc:1428] Setting key 7500b7b5e02e6a331616a98e57cbfeeb
I20260807 22:42:10.691969 17037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5: Bootstrap starting.
I20260807 22:42:10.694293 17037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:10.695163 17037 log.cc:824] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:10.696877 17040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:10.689290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:39055 (local address 127.0.0.1:37641)
0807 22:42:10.689762 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:10.689778 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:10.689814 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:42:10.690451 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:10.690468 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:10.690803 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:10.691134 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:10.691552 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:10.692598 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:10.693507 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:10.693981 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:10.694157 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:10.695099 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:10.695104 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:10.695118 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:10.695552 (+ 434us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:10.695606 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:10.695630 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:10.695774 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:10.695971 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 22:42:10.696116 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":152,"threads_started":1}
I20260807 22:42:10.697264 17037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5: No bootstrap required, opened a new log
I20260807 22:42:10.699992 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:10.701543 17037 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } }
I20260807 22:42:10.701789 17037 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:10.701862 17037 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b2d8ee9eb194827bb1fe5c673b19bd5, State: Initialized, Role: FOLLOWER
I20260807 22:42:10.702371 17037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } }
I20260807 22:42:10.702553 17037 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:10.702636 17037 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:10.702766 17037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:10.703719 17037 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } }
I20260807 22:42:10.704082 17037 leader_election.cc:302] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b2d8ee9eb194827bb1fe5c673b19bd5; no voters:
I20260807 22:42:10.704471 17037 leader_election.cc:288] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:10.704568 17047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:10.704826 17047 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 3b2d8ee9eb194827bb1fe5c673b19bd5, State: Running, Role: LEADER
I20260807 22:42:10.705168 17047 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } }
I20260807 22:42:10.705802 17037 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:10.706710 17049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b2d8ee9eb194827bb1fe5c673b19bd5. Latest consensus state: current_term: 1 leader_uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } } }
I20260807 22:42:10.706856 17049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:10.707089 17040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:10.702170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:52115 (local address 127.0.0.1:37641)
0807 22:42:10.702288 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:10.702292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:10.702540 (+ 248us) server_negotiation.cc:407] Connection header received
0807 22:42:10.702644 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:10.702647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:10.702721 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:10.702806 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:10.703105 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:10.703643 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:10.704823 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:10.705142 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:10.705223 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:10.706376 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:10.706381 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:10.706388 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:10.706401 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:10.706438 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:10.706452 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:10.706553 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:10.706860 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 22:42:10.706902 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":34}
I20260807 22:42:10.708215 17048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b2d8ee9eb194827bb1fe5c673b19bd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } } }
I20260807 22:42:10.709093 17048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5 [sys.catalog]: This master's current role is: LEADER
W20260807 22:42:10.711344 17064 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:42:10.711428 17064 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:10.711547 17057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:10.712580 17057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:10.719048 17057 catalog_manager.cc:1347] Generated new cluster ID: 43d656d29bf548a499aeb8154e146f53
I20260807 22:42:10.719131 17057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:10.732937 17057 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:10.734387 17057 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:10.741878 17057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b2d8ee9eb194827bb1fe5c673b19bd5: Generated new TSK 0
I20260807 22:42:10.742769 17057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:10.754673 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 16967
W20260807 22:42:10.762334 16952 connection.cc:535] client connection to 127.0.0.1:37641 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37641): Connection reset by peer (error 104)
2026-08-07T22:42:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1478 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:10 dist-test-slave-8w9v krb5kdc[17070](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:10 dist-test-slave-8w9v krb5kdc[17070](info): set up 2 sockets
Aug 07 22:42:10 dist-test-slave-8w9v krb5kdc[17070](info): commencing operation
krb5kdc: starting...
W20260807 22:42:11.839829 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:11 dist-test-slave-8w9v krb5kdc[17070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142531, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:11.972018 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39887
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:12.087589 17085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:12.087967 17085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:12.088060 17085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:12.092190 17085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:12.092305 17085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:12.092343 17085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:12.092392 17085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:12.092434 17085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:12.097918 17085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:12.099089 17085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:12.100167 17085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:12.109292 17091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:12.109357 17085 server_base.cc:1034] running on GCE node
W20260807 22:42:12.109285 17093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:12.109289 17090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:12.110298 17085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:12.111496 17085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:12.112809 17085 hybrid_clock.cc:648] HybridClock initialized: now 1786142532112793 us; error 29 us; skew 500 ppm
Aug 07 22:42:12 dist-test-slave-8w9v krb5kdc[17070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142532, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:12.119921 17085 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:12.121007 17085 webserver.cc:460] Webserver started at http://127.0.0.1:32863/ using document root <none> and password file <none>
I20260807 22:42:12.121656 17085 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:12.121755 17085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:12.122020 17085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:12.124276 17085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "ec3b6b1804c945539b68fe761c595e58"
format_stamp: "Formatted at 2026-08-07 22:42:12 on dist-test-slave-8w9v"
server_key: "00ff73ca768d382089b6797cb72d167d"
server_key_iv: "c30285f15fddb4f907d194dcb2af7e69"
server_key_version: "encryptionkey@0"
I20260807 22:42:12.124882 17085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "ec3b6b1804c945539b68fe761c595e58"
format_stamp: "Formatted at 2026-08-07 22:42:12 on dist-test-slave-8w9v"
server_key: "00ff73ca768d382089b6797cb72d167d"
server_key_iv: "c30285f15fddb4f907d194dcb2af7e69"
server_key_version: "encryptionkey@0"
I20260807 22:42:12.128849 17085 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:42:12.131372 17101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:12.132675 17085 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:42:12.132833 17085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "ec3b6b1804c945539b68fe761c595e58"
format_stamp: "Formatted at 2026-08-07 22:42:12 on dist-test-slave-8w9v"
server_key: "00ff73ca768d382089b6797cb72d167d"
server_key_iv: "c30285f15fddb4f907d194dcb2af7e69"
server_key_version: "encryptionkey@0"
I20260807 22:42:12.132961 17085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:12.137825 17085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:12.141182 17085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:12.141395 17085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:12.148437 17085 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39887
I20260807 22:42:12.148454 17155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39887 every 8 connection(s)
I20260807 22:42:12.149468 17085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:12.152344 17156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:12.158013 17156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58: Bootstrap starting.
I20260807 22:42:12.159654 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 17085
I20260807 22:42:12.159806 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:12.160190 26833 external_mini_cluster.cc:1428] Setting key 2ad559e05ca7120aa39c53569d073c57
I20260807 22:42:12.160930 17156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:12.161821 17156 log.cc:824] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:12.164253 17156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58: No bootstrap required, opened a new log
I20260807 22:42:12.165807 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:12.161406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:53691 (local address 127.0.0.1:39887)
0807 22:42:12.161948 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:12.161968 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:12.162013 (+ 45us) server_negotiation.cc:407] Connection header received
0807 22:42:12.162836 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:12.162861 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:12.163210 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:12.163578 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:12.164366 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:12.164372 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:12.164386 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:12.164400 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:12.164466 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:12.164494 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:12.164601 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:12.164727 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 22:42:12.164883 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":143,"threads_started":1}
I20260807 22:42:12.168814 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:12.168828 17156 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6b1804c945539b68fe761c595e58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39887 } }
I20260807 22:42:12.169097 17156 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:12.169183 17156 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec3b6b1804c945539b68fe761c595e58, State: Initialized, Role: FOLLOWER
I20260807 22:42:12.169638 17156 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6b1804c945539b68fe761c595e58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39887 } }
I20260807 22:42:12.169764 17156 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:12.169855 17156 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:12.169953 17156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:12.170899 17156 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6b1804c945539b68fe761c595e58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39887 } }
I20260807 22:42:12.171289 17156 leader_election.cc:302] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec3b6b1804c945539b68fe761c595e58; no voters:
I20260807 22:42:12.171679 17156 leader_election.cc:288] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:12.171778 17167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:12.172394 17167 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [term 1 LEADER]: Becoming Leader. State: Replica: ec3b6b1804c945539b68fe761c595e58, State: Running, Role: LEADER
I20260807 22:42:12.172722 17167 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6b1804c945539b68fe761c595e58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39887 } }
I20260807 22:42:12.172870 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:12.171044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:41299 (local address 127.0.0.1:39887)
0807 22:42:12.171165 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:12.171169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:12.171368 (+ 199us) server_negotiation.cc:407] Connection header received
0807 22:42:12.171498 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:12.171503 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:12.171540 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:12.171605 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:12.172426 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:12.172430 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:12.172433 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:12.172445 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:12.172475 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:12.172488 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:12.172569 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:12.172709 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 22:42:12.172754 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:42:12.173195 17156 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:12.174530 17169 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec3b6b1804c945539b68fe761c595e58. Latest consensus state: current_term: 1 leader_uuid: "ec3b6b1804c945539b68fe761c595e58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6b1804c945539b68fe761c595e58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39887 } } }
I20260807 22:42:12.174677 17169 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:12.175009 17168 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec3b6b1804c945539b68fe761c595e58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec3b6b1804c945539b68fe761c595e58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39887 } } }
I20260807 22:42:12.175098 17168 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58 [sys.catalog]: This master's current role is: LEADER
W20260807 22:42:12.178063 17182 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:42:12.178161 17182 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:12.178253 17178 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:12.179024 17178 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:12.185465 17178 catalog_manager.cc:1347] Generated new cluster ID: 5c379b33b51d4f04979466a1f161b203
I20260807 22:42:12.185554 17178 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:12.193065 17178 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:12.193425 17178 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:12.207463 17178 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec3b6b1804c945539b68fe761c595e58: Generated new TSK 0
I20260807 22:42:12.208451 17178 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:12.222285 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 17085
2026-08-07T22:42:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1468 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:12 dist-test-slave-8w9v krb5kdc[17188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:12 dist-test-slave-8w9v krb5kdc[17188](info): set up 2 sockets
Aug 07 22:42:12 dist-test-slave-8w9v krb5kdc[17188](info): commencing operation
krb5kdc: starting...
W20260807 22:42:13.311671 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:13 dist-test-slave-8w9v krb5kdc[17188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:13.448166 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38381
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:13.577966 17202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:13.578269 17202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:13.578320 17202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:13.582508 17202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:13.582578 17202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:13.582599 17202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:13.582664 17202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:13.582695 17202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:13.588378 17202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38381
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:13.589564 17202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:13.590657 17202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:42:13.599474 17202 server_base.cc:1034] running on GCE node
W20260807 22:42:13.599469 17210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:13.599489 17207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:13.599470 17208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:13.600421 17202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:13.601540 17202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:13.602774 17202 hybrid_clock.cc:648] HybridClock initialized: now 1786142533602755 us; error 31 us; skew 500 ppm
Aug 07 22:42:13 dist-test-slave-8w9v krb5kdc[17188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142533, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:13.605686 17202 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:13.606666 17202 webserver.cc:460] Webserver started at http://127.0.0.1:40513/ using document root <none> and password file <none>
I20260807 22:42:13.607264 17202 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:13.607359 17202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:13.607612 17202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:13.609931 17202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "2e9db454462248629d1bcc58a5c10d9a"
format_stamp: "Formatted at 2026-08-07 22:42:13 on dist-test-slave-8w9v"
server_key: "7a2c4c1d3d8e1d901163c3fc6668f10e"
server_key_iv: "77aef11e3aa6461c3b9ac737ae320738"
server_key_version: "encryptionkey@0"
I20260807 22:42:13.610536 17202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "2e9db454462248629d1bcc58a5c10d9a"
format_stamp: "Formatted at 2026-08-07 22:42:13 on dist-test-slave-8w9v"
server_key: "7a2c4c1d3d8e1d901163c3fc6668f10e"
server_key_iv: "77aef11e3aa6461c3b9ac737ae320738"
server_key_version: "encryptionkey@0"
I20260807 22:42:13.614543 17202 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 22:42:13.617185 17218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:13.618495 17202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:42:13.618647 17202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "2e9db454462248629d1bcc58a5c10d9a"
format_stamp: "Formatted at 2026-08-07 22:42:13 on dist-test-slave-8w9v"
server_key: "7a2c4c1d3d8e1d901163c3fc6668f10e"
server_key_iv: "77aef11e3aa6461c3b9ac737ae320738"
server_key_version: "encryptionkey@0"
I20260807 22:42:13.618767 17202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:13.635614 17202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:13.638842 17202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:13.639086 17202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:13.646929 17202 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38381
I20260807 22:42:13.646957 17272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38381 every 8 connection(s)
I20260807 22:42:13.647956 17202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:13.651008 17273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:13.656785 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 17202
I20260807 22:42:13.656944 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:13.656997 17273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a: Bootstrap starting.
I20260807 22:42:13.657269 26833 external_mini_cluster.cc:1428] Setting key 5006663717a437ba3b49e9d64c42db24
I20260807 22:42:13.659725 17273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:13.660564 17273 log.cc:824] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:13.662554 17273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a: No bootstrap required, opened a new log
Aug 07 22:42:13 dist-test-slave-8w9v krb5kdc[17188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:42:13.666282 17273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9db454462248629d1bcc58a5c10d9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38381 } }
I20260807 22:42:13.666566 17273 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:13.666638 17273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e9db454462248629d1bcc58a5c10d9a, State: Initialized, Role: FOLLOWER
I20260807 22:42:13.667174 17273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9db454462248629d1bcc58a5c10d9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38381 } }
I20260807 22:42:13.667312 17273 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:13.667409 17273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:13.667546 17273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:13.668550 17273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9db454462248629d1bcc58a5c10d9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38381 } }
I20260807 22:42:13.668910 17273 leader_election.cc:302] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e9db454462248629d1bcc58a5c10d9a; no voters:
I20260807 22:42:13.669231 17273 leader_election.cc:288] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:13.669351 17278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:13.669570 17278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [term 1 LEADER]: Becoming Leader. State: Replica: 2e9db454462248629d1bcc58a5c10d9a, State: Running, Role: LEADER
I20260807 22:42:13.669977 17278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9db454462248629d1bcc58a5c10d9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38381 } }
I20260807 22:42:13.670749 17273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:13.672879 17280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e9db454462248629d1bcc58a5c10d9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9db454462248629d1bcc58a5c10d9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38381 } } }
I20260807 22:42:13.672884 17279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e9db454462248629d1bcc58a5c10d9a. Latest consensus state: current_term: 1 leader_uuid: "2e9db454462248629d1bcc58a5c10d9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9db454462248629d1bcc58a5c10d9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38381 } } }
I20260807 22:42:13.673103 17280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:13.673110 17279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:13.673897 17276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:13.658767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:40493 (local address 127.0.0.1:38381)
0807 22:42:13.659235 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:13.659251 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:13.659288 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:42:13.660041 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:13.660060 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:13.660492 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:13.660836 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:13.661702 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:13.662751 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:13.663638 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:13.664171 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:13.664347 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:13.667189 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:13.667194 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:13.667207 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:13.667235 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:13.669398 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:13.670034 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:13.670041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:13.670047 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:13.670196 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:13.670615 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:13.670618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:13.670620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:13.671130 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:13.671342 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:13.672357 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0807 22:42:13.672649 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":149,"threads_started":1}
W20260807 22:42:13.676313 17292 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:42:13.676395 17292 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:13.676463 17293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:13.676995 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:13.677374 17293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:13.683815 17293 catalog_manager.cc:1347] Generated new cluster ID: e0c3bb53b28e485199b1edb7b2a0e2d1
I20260807 22:42:13.683885 17293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:13.687933 17276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:13.679089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:39107 (local address 127.0.0.1:38381)
0807 22:42:13.679212 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:13.679217 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:13.679439 (+ 222us) server_negotiation.cc:407] Connection header received
0807 22:42:13.679593 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:13.679596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:13.679647 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:13.679731 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:13.680524 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:13.681064 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:13.682030 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:13.682349 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:13.682456 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:13.684248 (+ 1792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:13.684252 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:13.684255 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:13.684283 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:13.686016 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:13.686601 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:13.686604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:13.686606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:13.686690 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:13.687035 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:13.687038 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:13.687040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:13.687239 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:13.687372 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:13.687685 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 22:42:13.687778 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:42:13.698700 17293 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:13.699786 17293 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:13.713351 17293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e9db454462248629d1bcc58a5c10d9a: Generated new TSK 0
I20260807 22:42:13.714268 17293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:13.725244 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 17202
W20260807 22:42:13.733179 17186 connection.cc:535] client connection to 127.0.0.1:38381 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38381): Connection reset by peer (error 104)
2026-08-07T22:42:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1502 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:13 dist-test-slave-8w9v krb5kdc[17305](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:13 dist-test-slave-8w9v krb5kdc[17305](info): set up 2 sockets
Aug 07 22:42:13 dist-test-slave-8w9v krb5kdc[17305](info): commencing operation
krb5kdc: starting...
W20260807 22:42:14.807147 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:14 dist-test-slave-8w9v krb5kdc[17305](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:14.937726 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35487
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:15.053815 17318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:15.054101 17318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:15.054185 17318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:15.058406 17318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:15.058485 17318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:15.058506 17318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:15.058523 17318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:15.058561 17318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:15.064105 17318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35487
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:15.065266 17318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:15.066327 17318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:15.075587 17324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:15.075590 17327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:15.075613 17318 server_base.cc:1034] running on GCE node
W20260807 22:42:15.075634 17325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:15.076591 17318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:15.077791 17318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:15.079013 17318 hybrid_clock.cc:648] HybridClock initialized: now 1786142535078990 us; error 33 us; skew 500 ppm
Aug 07 22:42:15 dist-test-slave-8w9v krb5kdc[17305](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142535, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:15.082068 17318 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:15.083132 17318 webserver.cc:460] Webserver started at http://127.0.0.1:39277/ using document root <none> and password file <none>
I20260807 22:42:15.083742 17318 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:15.083838 17318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:15.084096 17318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:15.086270 17318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "46e33735ceb444e5834ff4961b8739f4"
format_stamp: "Formatted at 2026-08-07 22:42:15 on dist-test-slave-8w9v"
server_key: "264de62da437bcd45144440a890c77f0"
server_key_iv: "262aee4c97d4c142ba97476ac1650047"
server_key_version: "encryptionkey@0"
I20260807 22:42:15.086791 17318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "46e33735ceb444e5834ff4961b8739f4"
format_stamp: "Formatted at 2026-08-07 22:42:15 on dist-test-slave-8w9v"
server_key: "264de62da437bcd45144440a890c77f0"
server_key_iv: "262aee4c97d4c142ba97476ac1650047"
server_key_version: "encryptionkey@0"
I20260807 22:42:15.090842 17318 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 22:42:15.093557 17334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:15.094938 17318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:42:15.095112 17318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "46e33735ceb444e5834ff4961b8739f4"
format_stamp: "Formatted at 2026-08-07 22:42:15 on dist-test-slave-8w9v"
server_key: "264de62da437bcd45144440a890c77f0"
server_key_iv: "262aee4c97d4c142ba97476ac1650047"
server_key_version: "encryptionkey@0"
I20260807 22:42:15.095249 17318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:15.109335 17318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:15.112703 17318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:15.112949 17318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:15.120689 17318 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35487
I20260807 22:42:15.120718 17389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35487 every 8 connection(s)
I20260807 22:42:15.121726 17318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:15.124642 17390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:15.125419 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 17318
I20260807 22:42:15.125573 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:15.125921 26833 external_mini_cluster.cc:1428] Setting key 0c67cc078e1d96fe7b6e6e20a3265dda
I20260807 22:42:15.131419 17390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4: Bootstrap starting.
I20260807 22:42:15.134230 17390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:15.135052 17390 log.cc:824] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:15.135260 17393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:15.127348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:40181 (local address 127.0.0.1:35487)
0807 22:42:15.127772 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:15.127795 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:15.127832 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:42:15.128561 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:15.128580 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:15.128934 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:15.129220 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:15.129604 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:15.130602 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:15.131789 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:15.132343 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:15.132476 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:15.133444 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:15.133449 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:15.133462 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:15.133856 (+ 394us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:15.133913 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:15.133936 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:15.134039 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:15.134278 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 22:42:15.134467 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":129,"threads_started":1}
I20260807 22:42:15.137398 17390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4: No bootstrap required, opened a new log
I20260807 22:42:15.138577 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:15.141794 17390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46e33735ceb444e5834ff4961b8739f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35487 } }
I20260807 22:42:15.142088 17390 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:15.142148 17390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46e33735ceb444e5834ff4961b8739f4, State: Initialized, Role: FOLLOWER
I20260807 22:42:15.142619 17390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46e33735ceb444e5834ff4961b8739f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35487 } }
I20260807 22:42:15.142750 17390 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:15.142831 17390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:15.142936 17390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:15.144202 17390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46e33735ceb444e5834ff4961b8739f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35487 } }
I20260807 22:42:15.144619 17390 leader_election.cc:302] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46e33735ceb444e5834ff4961b8739f4; no voters:
I20260807 22:42:15.144999 17390 leader_election.cc:288] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:15.145141 17400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:15.145419 17393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:15.140784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:50903 (local address 127.0.0.1:35487)
0807 22:42:15.140931 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:15.140936 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:15.141070 (+ 134us) server_negotiation.cc:407] Connection header received
0807 22:42:15.141176 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:15.141179 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:15.141229 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:15.141315 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:15.141633 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:15.142397 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:15.143408 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:15.143743 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:15.143857 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:15.144680 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:15.144683 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:15.144686 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:15.144702 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:15.144731 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:15.144745 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:15.144837 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:15.145255 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 22:42:15.145292 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:42:15.145478 17400 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [term 1 LEADER]: Becoming Leader. State: Replica: 46e33735ceb444e5834ff4961b8739f4, State: Running, Role: LEADER
I20260807 22:42:15.146106 17400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46e33735ceb444e5834ff4961b8739f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35487 } }
I20260807 22:42:15.146414 17390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:15.147710 17402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46e33735ceb444e5834ff4961b8739f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46e33735ceb444e5834ff4961b8739f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35487 } } }
I20260807 22:42:15.147847 17402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:15.148085 17402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46e33735ceb444e5834ff4961b8739f4. Latest consensus state: current_term: 1 leader_uuid: "46e33735ceb444e5834ff4961b8739f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46e33735ceb444e5834ff4961b8739f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35487 } } }
I20260807 22:42:15.148191 17402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:15.148569 17413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:15.151559 17413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:15.157413 17413 catalog_manager.cc:1347] Generated new cluster ID: 6f213d6dec7a4819b707935481597a47
I20260807 22:42:15.157487 17413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:15.180382 17413 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:15.181758 17413 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:15.198397 17413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46e33735ceb444e5834ff4961b8739f4: Generated new TSK 0
I20260807 22:42:15.199353 17413 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:15.207397 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 17318
W20260807 22:42:15.215718 17302 connection.cc:535] client connection to 127.0.0.1:35487 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35487): Connection reset by peer (error 104)
2026-08-07T22:42:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1482 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:15 dist-test-slave-8w9v krb5kdc[17424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:15 dist-test-slave-8w9v krb5kdc[17424](info): set up 2 sockets
Aug 07 22:42:15 dist-test-slave-8w9v krb5kdc[17424](info): commencing operation
krb5kdc: starting...
W20260807 22:42:16.291610 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:16 dist-test-slave-8w9v krb5kdc[17424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:42:16.428897 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41339
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:16.546144 17438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:16.546478 17438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:16.546521 17438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:16.550660 17438 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:16.550732 17438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:16.550752 17438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:16.550769 17438 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:16.550784 17438 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:16.556407 17438 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41339
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:16.557886 17438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:16.558913 17438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:42:16.568176 17438 server_base.cc:1034] running on GCE node
W20260807 22:42:16.568070 17444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:16.568063 17447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:16.568063 17445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:16.569037 17438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:16.570230 17438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:16.571435 17438 hybrid_clock.cc:648] HybridClock initialized: now 1786142536571419 us; error 29 us; skew 500 ppm
Aug 07 22:42:16 dist-test-slave-8w9v krb5kdc[17424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142536, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:16.574301 17438 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:42:16.575232 17438 webserver.cc:460] Webserver started at http://127.0.0.1:34155/ using document root <none> and password file <none>
I20260807 22:42:16.575841 17438 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:16.575906 17438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:16.576102 17438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:16.578282 17438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "07447df91cba40a0887cbc9cb73ad8ca"
format_stamp: "Formatted at 2026-08-07 22:42:16 on dist-test-slave-8w9v"
server_key: "4e187345b7e9acbbbbf3f65ddd57fdaa"
server_key_iv: "f3c57f64ca921fc66ddb5c0224b111b0"
server_key_version: "encryptionkey@0"
I20260807 22:42:16.578838 17438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "07447df91cba40a0887cbc9cb73ad8ca"
format_stamp: "Formatted at 2026-08-07 22:42:16 on dist-test-slave-8w9v"
server_key: "4e187345b7e9acbbbbf3f65ddd57fdaa"
server_key_iv: "f3c57f64ca921fc66ddb5c0224b111b0"
server_key_version: "encryptionkey@0"
I20260807 22:42:16.582818 17438 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260807 22:42:16.585440 17455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:16.586786 17438 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:42:16.586930 17438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "07447df91cba40a0887cbc9cb73ad8ca"
format_stamp: "Formatted at 2026-08-07 22:42:16 on dist-test-slave-8w9v"
server_key: "4e187345b7e9acbbbbf3f65ddd57fdaa"
server_key_iv: "f3c57f64ca921fc66ddb5c0224b111b0"
server_key_version: "encryptionkey@0"
I20260807 22:42:16.587044 17438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:16.591861 17438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:16.594908 17438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:16.595118 17438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:16.602597 17438 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41339
I20260807 22:42:16.602625 17513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41339 every 8 connection(s)
I20260807 22:42:16.603570 17438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:16.606382 17514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:16.606434 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 17438
I20260807 22:42:16.606600 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:16.606920 26833 external_mini_cluster.cc:1428] Setting key 6432596f9dc3869191d9dc77f77dd780
I20260807 22:42:16.612287 17517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:16.608392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:56193 (local address 127.0.0.1:41339)
0807 22:42:16.608840 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:16.608856 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:16.608891 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:42:16.609621 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:16.609638 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:16.609919 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:16.610276 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:16.611056 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:16.611061 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:16.611072 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:16.611084 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:16.611135 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:16.611154 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:16.611316 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:16.611385 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 22:42:16.611545 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":123,"threads_started":1}
I20260807 22:42:16.613372 17514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca: Bootstrap starting.
I20260807 22:42:16.615142 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:16.615926 17514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:16.616816 17514 log.cc:824] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:16.619086 17517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:16.617470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.214:36489 (local address 127.0.0.1:41339)
0807 22:42:16.617614 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:16.617621 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:16.617764 (+ 143us) server_negotiation.cc:407] Connection header received
0807 22:42:16.617890 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:16.617892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:16.617920 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:16.617990 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:16.618678 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:16.618681 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:16.618683 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:16.618693 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:16.618717 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:16.618728 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:16.618806 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:16.618914 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 22:42:16.618946 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:42:16.619488 17514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca: No bootstrap required, opened a new log
I20260807 22:42:16.623153 17514 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07447df91cba40a0887cbc9cb73ad8ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } }
I20260807 22:42:16.623423 17514 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:16.623487 17514 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07447df91cba40a0887cbc9cb73ad8ca, State: Initialized, Role: FOLLOWER
I20260807 22:42:16.623982 17514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07447df91cba40a0887cbc9cb73ad8ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } }
I20260807 22:42:16.624155 17514 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:16.624233 17514 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:16.624337 17514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:16.625327 17514 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07447df91cba40a0887cbc9cb73ad8ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } }
I20260807 22:42:16.625686 17514 leader_election.cc:302] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07447df91cba40a0887cbc9cb73ad8ca; no voters:
I20260807 22:42:16.626039 17514 leader_election.cc:288] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:16.626183 17525 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:16.626474 17525 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [term 1 LEADER]: Becoming Leader. State: Replica: 07447df91cba40a0887cbc9cb73ad8ca, State: Running, Role: LEADER
I20260807 22:42:16.626842 17525 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07447df91cba40a0887cbc9cb73ad8ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } }
I20260807 22:42:16.627357 17514 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:16.628633 17527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07447df91cba40a0887cbc9cb73ad8ca. Latest consensus state: current_term: 1 leader_uuid: "07447df91cba40a0887cbc9cb73ad8ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07447df91cba40a0887cbc9cb73ad8ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } } }
I20260807 22:42:16.628759 17527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:16.629112 17526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07447df91cba40a0887cbc9cb73ad8ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07447df91cba40a0887cbc9cb73ad8ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } } }
I20260807 22:42:16.629220 17526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:16.629578 17534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:16.632742 17534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:16.638077 17534 catalog_manager.cc:1347] Generated new cluster ID: e134b3f4cd05489083208914fdc42d9c
I20260807 22:42:16.638159 17534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:16.661900 17534 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:16.662295 17534 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:16.668846 17534 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07447df91cba40a0887cbc9cb73ad8ca: Generated new TSK 0
I20260807 22:42:16.669687 17534 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:16.682585 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 17438
2026-08-07T22:42:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1474 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:16 dist-test-slave-8w9v krb5kdc[17546](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:16 dist-test-slave-8w9v krb5kdc[17546](info): set up 2 sockets
Aug 07 22:42:16 dist-test-slave-8w9v krb5kdc[17546](info): commencing operation
krb5kdc: starting...
W20260807 22:42:17.782415 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:17 dist-test-slave-8w9v krb5kdc[17546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:42:17.920243 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:38019
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:46307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:38019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:18.040637 17559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:18.040997 17559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:18.041093 17559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:18.045632 17559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:18.045740 17559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:18.045778 17559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:18.045837 17559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:18.045892 17559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:18.051684 17559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:46307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:38019
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:38019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:18.052982 17559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:18.054109 17559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:18.063694 17565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:18.063694 17566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:18.063730 17568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:18.064177 17559 server_base.cc:1034] running on GCE node
I20260807 22:42:18.064821 17559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:18.065968 17559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:18.067176 17559 hybrid_clock.cc:648] HybridClock initialized: now 1786142538067157 us; error 27 us; skew 500 ppm
Aug 07 22:42:18 dist-test-slave-8w9v krb5kdc[17546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142538, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:18.073702 17559 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:42:18.074740 17559 webserver.cc:460] Webserver started at http://127.26.52.126:34825/ using document root <none> and password file <none>
I20260807 22:42:18.075318 17559 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:18.075379 17559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:18.075572 17559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:18.077817 17559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "ffe148e7c02c4e678b5ab5e7e49907b2"
format_stamp: "Formatted at 2026-08-07 22:42:18 on dist-test-slave-8w9v"
server_key: "9cf18b23d659696928f732c557a24437"
server_key_iv: "77dfd8eca45ceeda3bc8639735dea11b"
server_key_version: "encryptionkey@0"
I20260807 22:42:18.078361 17559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "ffe148e7c02c4e678b5ab5e7e49907b2"
format_stamp: "Formatted at 2026-08-07 22:42:18 on dist-test-slave-8w9v"
server_key: "9cf18b23d659696928f732c557a24437"
server_key_iv: "77dfd8eca45ceeda3bc8639735dea11b"
server_key_version: "encryptionkey@0"
I20260807 22:42:18.082348 17559 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260807 22:42:18.084901 17576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:18.086287 17559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:42:18.086455 17559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "ffe148e7c02c4e678b5ab5e7e49907b2"
format_stamp: "Formatted at 2026-08-07 22:42:18 on dist-test-slave-8w9v"
server_key: "9cf18b23d659696928f732c557a24437"
server_key_iv: "77dfd8eca45ceeda3bc8639735dea11b"
server_key_version: "encryptionkey@0"
I20260807 22:42:18.086580 17559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:18.102557 17559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:18.106220 17559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:18.106463 17559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:18.114115 17559 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:38019
I20260807 22:42:18.114130 17631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:38019 every 8 connection(s)
I20260807 22:42:18.115200 17559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:18.118239 17632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:18.118307 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 17559
I20260807 22:42:18.118451 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:18.118793 26833 external_mini_cluster.cc:1428] Setting key b6dba109fc73434302dd18ef7d886e1d
I20260807 22:42:18.125927 17632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2: Bootstrap starting.
I20260807 22:42:18.128616 17632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2: Neither blocks nor log segments found. Creating new log.
Aug 07 22:42:18 dist-test-slave-8w9v krb5kdc[17546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:42:18.129495 17632 log.cc:824] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:18.132248 17632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2: No bootstrap required, opened a new log
I20260807 22:42:18.135697 17635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:18.120452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58789 (local address 127.26.52.126:38019)
0807 22:42:18.120924 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:18.120945 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:18.120989 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:42:18.121977 (+ 988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:18.122003 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:18.122455 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:18.122844 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:18.123575 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:18.125127 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:18.126055 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:18.126722 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:18.126899 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:18.129627 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:18.129634 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:18.129651 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:18.129685 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:18.131902 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:18.132583 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:18.132589 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:18.132596 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:18.132756 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:18.133155 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:18.133158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:18.133160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:18.133684 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:18.133926 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:18.134327 (+ 401us) server_negotiation.cc:299] Negotiation successful
0807 22:42:18.134584 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":125,"threads_started":1}
I20260807 22:42:18.137219 17632 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe148e7c02c4e678b5ab5e7e49907b2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38019 } }
I20260807 22:42:18.137483 17632 raft_consensus.cc:374] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:18.137543 17632 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe148e7c02c4e678b5ab5e7e49907b2, State: Initialized, Role: FOLLOWER
I20260807 22:42:18.138054 17632 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe148e7c02c4e678b5ab5e7e49907b2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38019 } }
I20260807 22:42:18.138226 17632 raft_consensus.cc:388] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:18.138300 17632 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:18.138403 17632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:18.139037 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:18.139645 17632 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe148e7c02c4e678b5ab5e7e49907b2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38019 } }
I20260807 22:42:18.140057 17632 leader_election.cc:302] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffe148e7c02c4e678b5ab5e7e49907b2; no voters:
I20260807 22:42:18.140453 17632 leader_election.cc:288] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:18.140700 17638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:18.141040 17638 raft_consensus.cc:686] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [term 1 LEADER]: Becoming Leader. State: Replica: ffe148e7c02c4e678b5ab5e7e49907b2, State: Running, Role: LEADER
I20260807 22:42:18.141999 17632 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:18.141922 17638 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe148e7c02c4e678b5ab5e7e49907b2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38019 } }
I20260807 22:42:18.143889 17642 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffe148e7c02c4e678b5ab5e7e49907b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe148e7c02c4e678b5ab5e7e49907b2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38019 } } }
I20260807 22:42:18.144033 17642 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:18.144425 17644 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffe148e7c02c4e678b5ab5e7e49907b2. Latest consensus state: current_term: 1 leader_uuid: "ffe148e7c02c4e678b5ab5e7e49907b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe148e7c02c4e678b5ab5e7e49907b2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 38019 } } }
I20260807 22:42:18.144631 17644 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:18.144840 17658 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:18.148233 17658 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:18.150795 17635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:18.141583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55621 (local address 127.26.52.126:38019)
0807 22:42:18.141724 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:18.141729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:18.142009 (+ 280us) server_negotiation.cc:407] Connection header received
0807 22:42:18.142190 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:18.142195 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:18.142250 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:18.142345 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:18.143310 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:18.144166 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:18.145521 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:18.145839 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:18.145951 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:18.147418 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:18.147422 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:18.147425 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:18.147451 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:18.148957 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:18.149460 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:18.149464 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:18.149466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:18.149547 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:18.149887 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:18.149890 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:18.149892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:18.150077 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:18.150234 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:18.150522 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 22:42:18.150620 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:42:18.154448 17658 catalog_manager.cc:1347] Generated new cluster ID: dafd972419ba40118c883d4cff9cbd13
I20260807 22:42:18.154526 17658 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:18.167025 17658 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:18.167997 17658 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:18.176941 17658 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ffe148e7c02c4e678b5ab5e7e49907b2: Generated new TSK 0
I20260807 22:42:18.177703 17658 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:18.187994 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 17559
W20260807 22:42:18.195937 17544 connection.cc:535] client connection to 127.26.52.126:38019 recv error: Network error: failed to read from TLS socket (remote: 127.26.52.126:38019): Connection reset by peer (error 104)
2026-08-07T22:42:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1505 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:18 dist-test-slave-8w9v krb5kdc[17666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:18 dist-test-slave-8w9v krb5kdc[17666](info): set up 2 sockets
Aug 07 22:42:18 dist-test-slave-8w9v krb5kdc[17666](info): commencing operation
krb5kdc: starting...
W20260807 22:42:19.271164 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:19 dist-test-slave-8w9v krb5kdc[17666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:42:19.409653 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:43493
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:44213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:43493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:19.527429 17680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:19.527712 17680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:19.527793 17680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:19.531962 17680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:19.532043 17680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:19.532063 17680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:19.532080 17680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:19.532157 17680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:19.537882 17680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:44213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:43493
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:43493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:19.539062 17680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:19.540161 17680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:19.549170 17688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:19.549120 17685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:19.549120 17686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:19.549526 17680 server_base.cc:1034] running on GCE node
I20260807 22:42:19.550114 17680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:19.551229 17680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:19.552412 17680 hybrid_clock.cc:648] HybridClock initialized: now 1786142539552390 us; error 33 us; skew 500 ppm
Aug 07 22:42:19 dist-test-slave-8w9v krb5kdc[17666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142539, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:19.555492 17680 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:42:19.556746 17680 webserver.cc:460] Webserver started at http://127.26.52.126:39527/ using document root <none> and password file <none>
I20260807 22:42:19.557443 17680 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:19.557555 17680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:19.557850 17680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:19.560326 17680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "b0f24e09ab244941bc3ddba6e1cffb11"
format_stamp: "Formatted at 2026-08-07 22:42:19 on dist-test-slave-8w9v"
server_key: "d0dca34a13b957a77b8afe449eadeda7"
server_key_iv: "b3314baf252efd3a89986dfecffb1b30"
server_key_version: "encryptionkey@0"
I20260807 22:42:19.561029 17680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "b0f24e09ab244941bc3ddba6e1cffb11"
format_stamp: "Formatted at 2026-08-07 22:42:19 on dist-test-slave-8w9v"
server_key: "d0dca34a13b957a77b8afe449eadeda7"
server_key_iv: "b3314baf252efd3a89986dfecffb1b30"
server_key_version: "encryptionkey@0"
I20260807 22:42:19.565623 17680 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:42:19.568365 17695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:19.569757 17680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:42:19.569940 17680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "b0f24e09ab244941bc3ddba6e1cffb11"
format_stamp: "Formatted at 2026-08-07 22:42:19 on dist-test-slave-8w9v"
server_key: "d0dca34a13b957a77b8afe449eadeda7"
server_key_iv: "b3314baf252efd3a89986dfecffb1b30"
server_key_version: "encryptionkey@0"
I20260807 22:42:19.570075 17680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:19.608706 17680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:19.612237 17680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:19.612424 17680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:19.619717 17680 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:43493
I20260807 22:42:19.619786 17754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:43493 every 8 connection(s)
I20260807 22:42:19.620846 17680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:19.623991 17755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:19.628436 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 17680
I20260807 22:42:19.628600 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:19.628901 26833 external_mini_cluster.cc:1428] Setting key faf6896039937d8d51a0d46eb487c78d
I20260807 22:42:19.630520 17755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11: Bootstrap starting.
I20260807 22:42:19.633534 17755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:19.634500 17755 log.cc:824] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:19.636992 17755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11: No bootstrap required, opened a new log
I20260807 22:42:19.639499 17758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:19.630466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42283 (local address 127.26.52.126:43493)
0807 22:42:19.630958 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:19.630979 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:19.631025 (+ 46us) server_negotiation.cc:407] Connection header received
0807 22:42:19.631950 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:19.631979 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:19.632468 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:19.632833 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:19.633285 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:19.634829 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:19.636005 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:19.636595 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:19.636747 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:19.637695 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:19.637701 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:19.637714 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:19.638138 (+ 424us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:19.638193 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:19.638216 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:19.638325 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:19.638553 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 22:42:19.638716 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":162,"threads_started":1}
I20260807 22:42:19.641053 17755 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f24e09ab244941bc3ddba6e1cffb11" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43493 } }
I20260807 22:42:19.641305 17755 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:19.641382 17755 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f24e09ab244941bc3ddba6e1cffb11, State: Initialized, Role: FOLLOWER
I20260807 22:42:19.641886 17755 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f24e09ab244941bc3ddba6e1cffb11" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43493 } }
I20260807 22:42:19.642053 17755 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:19.642153 17755 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:19.642270 17755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:19.642666 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:19.643364 17755 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f24e09ab244941bc3ddba6e1cffb11" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43493 } }
I20260807 22:42:19.643728 17755 leader_election.cc:302] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0f24e09ab244941bc3ddba6e1cffb11; no voters:
I20260807 22:42:19.644155 17755 leader_election.cc:288] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:19.644220 17763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:19.644450 17763 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [term 1 LEADER]: Becoming Leader. State: Replica: b0f24e09ab244941bc3ddba6e1cffb11, State: Running, Role: LEADER
I20260807 22:42:19.644835 17763 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f24e09ab244941bc3ddba6e1cffb11" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43493 } }
I20260807 22:42:19.645581 17755 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:19.646600 17765 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0f24e09ab244941bc3ddba6e1cffb11. Latest consensus state: current_term: 1 leader_uuid: "b0f24e09ab244941bc3ddba6e1cffb11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f24e09ab244941bc3ddba6e1cffb11" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43493 } } }
I20260807 22:42:19.646791 17765 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:19.647046 17766 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0f24e09ab244941bc3ddba6e1cffb11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f24e09ab244941bc3ddba6e1cffb11" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 43493 } } }
I20260807 22:42:19.647186 17766 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:19.647547 17774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:19.650319 17758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:19.645238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53069 (local address 127.26.52.126:43493)
0807 22:42:19.645339 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:19.645343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:19.645424 (+ 81us) server_negotiation.cc:407] Connection header received
0807 22:42:19.645598 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:19.645601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:19.645658 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:19.645728 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:19.646132 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:19.647143 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:19.648395 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:19.648709 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:19.648819 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:19.649777 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:19.649781 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:19.649783 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:19.649797 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:19.649833 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:19.649844 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:19.649952 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:19.650109 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 22:42:19.650160 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 22:42:19.651098 17774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:19.657267 17774 catalog_manager.cc:1347] Generated new cluster ID: 72b43459f37d4fa2bb12431101861b34
I20260807 22:42:19.657359 17774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:19.682488 17774 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:19.683503 17774 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:19.699026 17774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0f24e09ab244941bc3ddba6e1cffb11: Generated new TSK 0
I20260807 22:42:19.699805 17774 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:19.706022 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 17680
W20260807 22:42:19.716071 17664 connection.cc:535] client connection to 127.26.52.126:43493 recv error: Network error: failed to read from TLS socket (remote: 127.26.52.126:43493): Connection reset by peer (error 104)
2026-08-07T22:42:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1520 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:19 dist-test-slave-8w9v krb5kdc[17786](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:19 dist-test-slave-8w9v krb5kdc[17786](info): set up 2 sockets
Aug 07 22:42:19 dist-test-slave-8w9v krb5kdc[17786](info): commencing operation
krb5kdc: starting...
W20260807 22:42:20.787587 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:20 dist-test-slave-8w9v krb5kdc[17786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:42:20.921291 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40377
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:35701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:40377
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:21.038451 17802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:21.038751 17802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:21.038795 17802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:21.042961 17802 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:21.043040 17802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:21.043061 17802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:21.043077 17802 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:21.043092 17802 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:21.048610 17802 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:35701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:40377
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:40377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:21.049801 17802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:21.050896 17802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:21.059883 17811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:21.060067 17802 server_base.cc:1034] running on GCE node
W20260807 22:42:21.059870 17808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:21.059876 17809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:21.060922 17802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:21.062093 17802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:21.063288 17802 hybrid_clock.cc:648] HybridClock initialized: now 1786142541063263 us; error 43 us; skew 500 ppm
Aug 07 22:42:21 dist-test-slave-8w9v krb5kdc[17786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142541, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:21.066115 17802 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:42:21.067142 17802 webserver.cc:460] Webserver started at http://127.26.52.126:40913/ using document root <none> and password file <none>
I20260807 22:42:21.067808 17802 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:21.067873 17802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:21.068105 17802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:21.070325 17802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "bed008adf1684e56815e7801359eaf2a"
format_stamp: "Formatted at 2026-08-07 22:42:21 on dist-test-slave-8w9v"
server_key: "66cf3535882a1417a8c366f5e01a5710"
server_key_iv: "572b4915b7b8d6f0bf0f480df5e5c097"
server_key_version: "encryptionkey@0"
I20260807 22:42:21.070948 17802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "bed008adf1684e56815e7801359eaf2a"
format_stamp: "Formatted at 2026-08-07 22:42:21 on dist-test-slave-8w9v"
server_key: "66cf3535882a1417a8c366f5e01a5710"
server_key_iv: "572b4915b7b8d6f0bf0f480df5e5c097"
server_key_version: "encryptionkey@0"
I20260807 22:42:21.075016 17802 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260807 22:42:21.077762 17819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:21.079273 17802 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:42:21.079471 17802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "bed008adf1684e56815e7801359eaf2a"
format_stamp: "Formatted at 2026-08-07 22:42:21 on dist-test-slave-8w9v"
server_key: "66cf3535882a1417a8c366f5e01a5710"
server_key_iv: "572b4915b7b8d6f0bf0f480df5e5c097"
server_key_version: "encryptionkey@0"
I20260807 22:42:21.079607 17802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:21.084620 17802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:21.087631 17802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:21.087853 17802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:21.095669 17802 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:40377
I20260807 22:42:21.095698 17872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:40377 every 8 connection(s)
I20260807 22:42:21.096762 17802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:21.098886 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 17802
I20260807 22:42:21.099040 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:21.099328 26833 external_mini_cluster.cc:1428] Setting key 4ce51f1fa2003e3d82e94cdfca307d3a
I20260807 22:42:21.099834 17873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:21.104841 17876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:21.100913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45873 (local address 127.26.52.126:40377)
0807 22:42:21.101343 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:21.101361 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:21.101405 (+ 44us) server_negotiation.cc:407] Connection header received
0807 22:42:21.102070 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:21.102085 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:21.102357 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:21.102631 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:21.103528 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:21.103533 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:21.103544 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:21.103555 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:21.103608 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:21.103628 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:21.103740 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:21.103884 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 22:42:21.104055 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":150,"threads_started":1}
I20260807 22:42:21.107100 17873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a: Bootstrap starting.
I20260807 22:42:21.107838 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:21.109683 17873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:21.110666 17873 log.cc:824] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:21.111903 17876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:21.110064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53783 (local address 127.26.52.126:40377)
0807 22:42:21.110208 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:21.110213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:21.110421 (+ 208us) server_negotiation.cc:407] Connection header received
0807 22:42:21.110560 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:21.110562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:21.110594 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:21.110658 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:21.111472 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:21.111476 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:21.111479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:21.111490 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:21.111522 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:21.111533 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:21.111625 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:21.111743 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 22:42:21.111783 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:42:21.113065 17873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a: No bootstrap required, opened a new log
I20260807 22:42:21.117063 17873 raft_consensus.cc:348] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed008adf1684e56815e7801359eaf2a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40377 } }
I20260807 22:42:21.117322 17873 raft_consensus.cc:374] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:21.117404 17873 raft_consensus.cc:729] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed008adf1684e56815e7801359eaf2a, State: Initialized, Role: FOLLOWER
I20260807 22:42:21.117873 17873 consensus_queue.cc:260] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed008adf1684e56815e7801359eaf2a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40377 } }
I20260807 22:42:21.118026 17873 raft_consensus.cc:388] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:21.118119 17873 raft_consensus.cc:482] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:21.118237 17873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:21.119325 17873 raft_consensus.cc:504] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed008adf1684e56815e7801359eaf2a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40377 } }
I20260807 22:42:21.119688 17873 leader_election.cc:302] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bed008adf1684e56815e7801359eaf2a; no voters:
I20260807 22:42:21.120038 17873 leader_election.cc:288] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:21.120289 17886 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:21.120606 17886 raft_consensus.cc:686] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [term 1 LEADER]: Becoming Leader. State: Replica: bed008adf1684e56815e7801359eaf2a, State: Running, Role: LEADER
I20260807 22:42:21.121016 17886 consensus_queue.cc:237] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed008adf1684e56815e7801359eaf2a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40377 } }
I20260807 22:42:21.121548 17873 sys_catalog.cc:564] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:21.122892 17888 sys_catalog.cc:455] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bed008adf1684e56815e7801359eaf2a. Latest consensus state: current_term: 1 leader_uuid: "bed008adf1684e56815e7801359eaf2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed008adf1684e56815e7801359eaf2a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40377 } } }
I20260807 22:42:21.123019 17888 sys_catalog.cc:458] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:21.123385 17887 sys_catalog.cc:455] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bed008adf1684e56815e7801359eaf2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed008adf1684e56815e7801359eaf2a" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 40377 } } }
I20260807 22:42:21.123486 17887 sys_catalog.cc:458] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:21.123469 17895 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:21.126669 17895 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:21.132501 17895 catalog_manager.cc:1347] Generated new cluster ID: bd80bc7ca312466e8cb301c26850befc
I20260807 22:42:21.132586 17895 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:21.146380 17895 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:21.146736 17895 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:21.171211 17895 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bed008adf1684e56815e7801359eaf2a: Generated new TSK 0
I20260807 22:42:21.172019 17895 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:21.174901 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 17802
2026-08-07T22:42:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1466 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:21 dist-test-slave-8w9v krb5kdc[17907](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:21 dist-test-slave-8w9v krb5kdc[17907](info): set up 2 sockets
Aug 07 22:42:21 dist-test-slave-8w9v krb5kdc[17907](info): commencing operation
krb5kdc: starting...
W20260807 22:42:22.256332 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:22 dist-test-slave-8w9v krb5kdc[17907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:42:22.393427 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:34973
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:41525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:34973
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:22.509863 17920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:22.510149 17920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:22.510192 17920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:22.514374 17920 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:22.514449 17920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:22.514469 17920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:22.514487 17920 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:22.514503 17920 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:22.519933 17920 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:41525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:34973
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:34973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:22.521158 17920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:22.522248 17920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:22.531035 17925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:22.531039 17928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:22.531097 17926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:22.531378 17920 server_base.cc:1034] running on GCE node
I20260807 22:42:22.532161 17920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:22.533350 17920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:22.534515 17920 hybrid_clock.cc:648] HybridClock initialized: now 1786142542534490 us; error 41 us; skew 500 ppm
Aug 07 22:42:22 dist-test-slave-8w9v krb5kdc[17907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142542, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:22.537281 17920 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:42:22.538149 17920 webserver.cc:460] Webserver started at http://127.26.52.126:45313/ using document root <none> and password file <none>
I20260807 22:42:22.538677 17920 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:22.538734 17920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:22.538902 17920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:22.541054 17920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "e55006e0469d40d9a3d06f4a35eff267"
format_stamp: "Formatted at 2026-08-07 22:42:22 on dist-test-slave-8w9v"
server_key: "958a17903a87151f450992d01231cba5"
server_key_iv: "e9028be1a84dc5b1a75e85137e7765f9"
server_key_version: "encryptionkey@0"
I20260807 22:42:22.541572 17920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "e55006e0469d40d9a3d06f4a35eff267"
format_stamp: "Formatted at 2026-08-07 22:42:22 on dist-test-slave-8w9v"
server_key: "958a17903a87151f450992d01231cba5"
server_key_iv: "e9028be1a84dc5b1a75e85137e7765f9"
server_key_version: "encryptionkey@0"
I20260807 22:42:22.545291 17920 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 22:42:22.547720 17936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:22.549014 17920 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:42:22.549149 17920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "e55006e0469d40d9a3d06f4a35eff267"
format_stamp: "Formatted at 2026-08-07 22:42:22 on dist-test-slave-8w9v"
server_key: "958a17903a87151f450992d01231cba5"
server_key_iv: "e9028be1a84dc5b1a75e85137e7765f9"
server_key_version: "encryptionkey@0"
I20260807 22:42:22.549254 17920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:22.561298 17920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:22.564702 17920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:22.564926 17920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:22.572438 17920 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:34973
I20260807 22:42:22.572523 17990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:34973 every 8 connection(s)
I20260807 22:42:22.573478 17920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:22.576418 17991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:22.581223 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 17920
I20260807 22:42:22.581346 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:22.581646 26833 external_mini_cluster.cc:1428] Setting key bfa03dba10ad3f356f23b8fa381be18f
I20260807 22:42:22.582638 17991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267: Bootstrap starting.
I20260807 22:42:22.585219 17991 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:22.586019 17991 log.cc:824] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:22.587993 17991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267: No bootstrap required, opened a new log
Aug 07 22:42:22 dist-test-slave-8w9v krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:42:22.591809 17991 raft_consensus.cc:348] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55006e0469d40d9a3d06f4a35eff267" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34973 } }
I20260807 22:42:22.592106 17991 raft_consensus.cc:374] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:22.592199 17991 raft_consensus.cc:729] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e55006e0469d40d9a3d06f4a35eff267, State: Initialized, Role: FOLLOWER
I20260807 22:42:22.592716 17991 consensus_queue.cc:260] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55006e0469d40d9a3d06f4a35eff267" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34973 } }
I20260807 22:42:22.592855 17991 raft_consensus.cc:388] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:22.592942 17991 raft_consensus.cc:482] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:22.593065 17991 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:22.594067 17991 raft_consensus.cc:504] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55006e0469d40d9a3d06f4a35eff267" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34973 } }
I20260807 22:42:22.594415 17991 leader_election.cc:302] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e55006e0469d40d9a3d06f4a35eff267; no voters:
I20260807 22:42:22.594794 17991 leader_election.cc:288] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:22.594897 17996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:22.595364 17996 raft_consensus.cc:686] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [term 1 LEADER]: Becoming Leader. State: Replica: e55006e0469d40d9a3d06f4a35eff267, State: Running, Role: LEADER
I20260807 22:42:22.595743 17996 consensus_queue.cc:237] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55006e0469d40d9a3d06f4a35eff267" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34973 } }
I20260807 22:42:22.596252 17991 sys_catalog.cc:564] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:22.596454 17994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:22.583074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46081 (local address 127.26.52.126:34973)
0807 22:42:22.583570 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:22.583586 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:22.583622 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:42:22.584368 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:22.584387 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:22.584743 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:22.585089 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:22.585944 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:22.586969 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:22.587852 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:22.588400 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:22.588581 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:22.591089 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:22.591094 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:22.591107 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:22.591134 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:22.593065 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:22.593540 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:22.593546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:22.593553 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:22.593673 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:22.593964 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:22.593969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:22.593971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:22.594449 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:22.594657 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:22.595056 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 22:42:22.595386 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":166,"threads_started":1}
I20260807 22:42:22.597541 17998 sys_catalog.cc:455] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e55006e0469d40d9a3d06f4a35eff267" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55006e0469d40d9a3d06f4a35eff267" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34973 } } }
I20260807 22:42:22.597661 17998 sys_catalog.cc:458] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:22.597990 17997 sys_catalog.cc:455] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e55006e0469d40d9a3d06f4a35eff267. Latest consensus state: current_term: 1 leader_uuid: "e55006e0469d40d9a3d06f4a35eff267" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55006e0469d40d9a3d06f4a35eff267" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34973 } } }
I20260807 22:42:22.598066 17997 sys_catalog.cc:458] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:22.599028 18005 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:22.599994 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:22.602385 18005 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:22.610530 18005 catalog_manager.cc:1347] Generated new cluster ID: 717a8ca9c16f4f61b316959ba4e13afc
I20260807 22:42:22.610615 18005 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:22.612303 17994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:22.603039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54663 (local address 127.26.52.126:34973)
0807 22:42:22.603154 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:22.603159 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:22.603524 (+ 365us) server_negotiation.cc:407] Connection header received
0807 22:42:22.603644 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:22.603647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:22.603697 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:22.603781 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:22.604641 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:22.605468 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:22.606574 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:22.606923 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:22.607036 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:22.608731 (+ 1695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:22.608735 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:22.608738 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:22.608765 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:22.610421 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:22.610913 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:22.610917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:22.610919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:22.611011 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:22.611348 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:22.611351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:22.611353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:22.611594 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:22.611716 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:22.611997 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 22:42:22.612116 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:42:22.627053 18005 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:22.628371 18005 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:22.640802 18005 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e55006e0469d40d9a3d06f4a35eff267: Generated new TSK 0
I20260807 22:42:22.641712 18005 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:22.649111 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 17920
2026-08-07T22:42:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1475 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:22 dist-test-slave-8w9v krb5kdc[18024](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:22 dist-test-slave-8w9v krb5kdc[18024](info): set up 2 sockets
Aug 07 22:42:22 dist-test-slave-8w9v krb5kdc[18024](info): commencing operation
krb5kdc: starting...
W20260807 22:42:23.739821 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:23 dist-test-slave-8w9v krb5kdc[18024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:42:23.877352 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:34367
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:39215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:34367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:23.995159 18042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:23.995646 18042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:23.995736 18042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:24.000006 18042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:24.000095 18042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:24.000135 18042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:24.000154 18042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:24.000170 18042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:24.005939 18042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:39215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:34367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:34367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:24.007119 18042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:24.008211 18042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:24.017453 18051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:24.017639 18042 server_base.cc:1034] running on GCE node
W20260807 22:42:24.017477 18048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:24.017462 18049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:24.018510 18042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:24.019985 18042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:24.021201 18042 hybrid_clock.cc:648] HybridClock initialized: now 1786142544021190 us; error 41 us; skew 500 ppm
Aug 07 22:42:24 dist-test-slave-8w9v krb5kdc[18024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142544, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:24.024099 18042 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:42:24.025202 18042 webserver.cc:460] Webserver started at http://127.26.52.126:34449/ using document root <none> and password file <none>
I20260807 22:42:24.025837 18042 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:24.025935 18042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:24.026196 18042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:24.028503 18042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "194a6b0482364765846ceba0c12686a2"
format_stamp: "Formatted at 2026-08-07 22:42:24 on dist-test-slave-8w9v"
server_key: "bbb290bb74b26b44d9f92e82eb657961"
server_key_iv: "d2c83ad66147fe9c7d280118df5c4cb8"
server_key_version: "encryptionkey@0"
I20260807 22:42:24.029111 18042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "194a6b0482364765846ceba0c12686a2"
format_stamp: "Formatted at 2026-08-07 22:42:24 on dist-test-slave-8w9v"
server_key: "bbb290bb74b26b44d9f92e82eb657961"
server_key_iv: "d2c83ad66147fe9c7d280118df5c4cb8"
server_key_version: "encryptionkey@0"
I20260807 22:42:24.033262 18042 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:42:24.036008 18058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:24.037362 18042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 22:42:24.037531 18042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "194a6b0482364765846ceba0c12686a2"
format_stamp: "Formatted at 2026-08-07 22:42:24 on dist-test-slave-8w9v"
server_key: "bbb290bb74b26b44d9f92e82eb657961"
server_key_iv: "d2c83ad66147fe9c7d280118df5c4cb8"
server_key_version: "encryptionkey@0"
I20260807 22:42:24.037665 18042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:24.083045 18042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:24.086349 18042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:24.086577 18042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:24.094128 18042 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:34367
I20260807 22:42:24.094153 18112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:34367 every 8 connection(s)
I20260807 22:42:24.095112 18042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:24.095546 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 18042
I20260807 22:42:24.095705 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:24.096012 26833 external_mini_cluster.cc:1428] Setting key 9198ba915e98416ef3d304a8c14f534b
I20260807 22:42:24.098403 18113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:24.105142 18113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2: Bootstrap starting.
I20260807 22:42:24.105739 18116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:24.097615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58339 (local address 127.26.52.126:34367)
0807 22:42:24.098062 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:24.098078 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:24.098115 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:42:24.098823 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:24.098841 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:24.099169 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:24.099453 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:24.099858 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:24.100946 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:24.102215 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:24.102697 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:24.102831 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:24.103752 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:24.103757 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:24.103769 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:24.104247 (+ 478us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:24.104311 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:24.104367 (+ 56us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:24.104453 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:24.104623 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 22:42:24.104861 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":155,"threads_started":1}
I20260807 22:42:24.107570 18113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:24.108551 18113 log.cc:824] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:24.108695 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:24.110719 18113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2: No bootstrap required, opened a new log
I20260807 22:42:24.115115 18116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:24.110891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55011 (local address 127.26.52.126:34367)
0807 22:42:24.111023 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:24.111028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:24.111210 (+ 182us) server_negotiation.cc:407] Connection header received
0807 22:42:24.111301 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:24.111304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:24.111350 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:24.111436 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:24.111686 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:24.112494 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:24.113296 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:24.113663 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:24.113772 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:24.114614 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:24.114618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:24.114621 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:24.114634 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:24.114664 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:24.114678 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:24.114756 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:24.114916 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 22:42:24.114970 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:42:24.115988 18113 raft_consensus.cc:348] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a6b0482364765846ceba0c12686a2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34367 } }
I20260807 22:42:24.116359 18113 raft_consensus.cc:374] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:24.116429 18113 raft_consensus.cc:729] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 194a6b0482364765846ceba0c12686a2, State: Initialized, Role: FOLLOWER
I20260807 22:42:24.116915 18113 consensus_queue.cc:260] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a6b0482364765846ceba0c12686a2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34367 } }
I20260807 22:42:24.117046 18113 raft_consensus.cc:388] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:24.117089 18113 raft_consensus.cc:482] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:24.117161 18113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:24.118085 18113 raft_consensus.cc:504] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a6b0482364765846ceba0c12686a2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34367 } }
I20260807 22:42:24.118396 18113 leader_election.cc:302] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 194a6b0482364765846ceba0c12686a2; no voters:
I20260807 22:42:24.118723 18113 leader_election.cc:288] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:24.118876 18123 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:24.119154 18123 raft_consensus.cc:686] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [term 1 LEADER]: Becoming Leader. State: Replica: 194a6b0482364765846ceba0c12686a2, State: Running, Role: LEADER
I20260807 22:42:24.119580 18123 consensus_queue.cc:237] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a6b0482364765846ceba0c12686a2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34367 } }
I20260807 22:42:24.120218 18113 sys_catalog.cc:564] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:24.121606 18124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "194a6b0482364765846ceba0c12686a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a6b0482364765846ceba0c12686a2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34367 } } }
I20260807 22:42:24.121598 18125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 194a6b0482364765846ceba0c12686a2. Latest consensus state: current_term: 1 leader_uuid: "194a6b0482364765846ceba0c12686a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a6b0482364765846ceba0c12686a2" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34367 } } }
I20260807 22:42:24.121748 18125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:24.121748 18124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:24.122231 18134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:24.125422 18134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:24.130793 18134 catalog_manager.cc:1347] Generated new cluster ID: 7b13c6ead423488eac694088c7e44dca
I20260807 22:42:24.130880 18134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:24.155571 18134 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:24.156687 18134 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:24.171084 18134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 194a6b0482364765846ceba0c12686a2: Generated new TSK 0
I20260807 22:42:24.171898 18134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:24.185787 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 18042
2026-08-07T22:42:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1535 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:24 dist-test-slave-8w9v krb5kdc[18147](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:24 dist-test-slave-8w9v krb5kdc[18147](info): set up 2 sockets
Aug 07 22:42:24 dist-test-slave-8w9v krb5kdc[18147](info): commencing operation
krb5kdc: starting...
W20260807 22:42:25.259442 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:25 dist-test-slave-8w9v krb5kdc[18147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:42:25.395215 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:34115
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:34115
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:25.514809 18160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:25.515110 18160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:25.515154 18160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:25.519327 18160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:25.519409 18160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:25.519429 18160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:25.519446 18160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:25.519462 18160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:25.525224 18160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:34115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:34115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:25.526418 18160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:25.527498 18160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:25.536932 18165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:25.536921 18169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:25.536927 18167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:25.537074 18160 server_base.cc:1034] running on GCE node
I20260807 22:42:25.537966 18160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:25.539183 18160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:25.540357 18160 hybrid_clock.cc:648] HybridClock initialized: now 1786142545540343 us; error 32 us; skew 500 ppm
Aug 07 22:42:25 dist-test-slave-8w9v krb5kdc[18147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142545, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:25.543226 18160 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:42:25.544318 18160 webserver.cc:460] Webserver started at http://127.26.52.126:45955/ using document root <none> and password file <none>
I20260807 22:42:25.544914 18160 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:25.545008 18160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:25.545260 18160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:25.547462 18160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "3f1a0d4ed3db4893a389f482bc78e9a0"
format_stamp: "Formatted at 2026-08-07 22:42:25 on dist-test-slave-8w9v"
server_key: "5115f639c2decfaa7ffa2a92da844f9f"
server_key_iv: "9ade2bcca4d7438bc7f636ccd588cde1"
server_key_version: "encryptionkey@0"
I20260807 22:42:25.548074 18160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "3f1a0d4ed3db4893a389f482bc78e9a0"
format_stamp: "Formatted at 2026-08-07 22:42:25 on dist-test-slave-8w9v"
server_key: "5115f639c2decfaa7ffa2a92da844f9f"
server_key_iv: "9ade2bcca4d7438bc7f636ccd588cde1"
server_key_version: "encryptionkey@0"
I20260807 22:42:25.551939 18160 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260807 22:42:25.554631 18177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:25.555980 18160 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 22:42:25.556187 18160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "3f1a0d4ed3db4893a389f482bc78e9a0"
format_stamp: "Formatted at 2026-08-07 22:42:25 on dist-test-slave-8w9v"
server_key: "5115f639c2decfaa7ffa2a92da844f9f"
server_key_iv: "9ade2bcca4d7438bc7f636ccd588cde1"
server_key_version: "encryptionkey@0"
I20260807 22:42:25.556344 18160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:25.561460 18160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:25.565078 18160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:25.565335 18160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:25.573067 18160 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:34115
I20260807 22:42:25.573096 18233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:34115 every 8 connection(s)
I20260807 22:42:25.574110 18160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:25.577099 18234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:25.582965 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 18160
I20260807 22:42:25.583119 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:25.583217 18234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0: Bootstrap starting.
I20260807 22:42:25.583462 26833 external_mini_cluster.cc:1428] Setting key 7b3fdc13e8f4e58055d000b8f0ae65b5
I20260807 22:42:25.586024 18234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:25.586790 18234 log.cc:824] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:25.589025 18234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0: No bootstrap required, opened a new log
I20260807 22:42:25.589044 18237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:25.585005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48023 (local address 127.26.52.126:34115)
0807 22:42:25.585489 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:25.585504 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:25.585542 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:42:25.586279 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:25.586300 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:25.586588 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:25.586942 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:25.587819 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:25.587824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:25.587836 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:25.587848 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:25.587904 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:25.587924 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:25.588048 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:25.588183 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 22:42:25.588351 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":135,"threads_started":1}
I20260807 22:42:25.592198 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:25.593271 18234 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1a0d4ed3db4893a389f482bc78e9a0" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34115 } }
I20260807 22:42:25.593585 18234 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:25.593659 18234 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1a0d4ed3db4893a389f482bc78e9a0, State: Initialized, Role: FOLLOWER
I20260807 22:42:25.594110 18234 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1a0d4ed3db4893a389f482bc78e9a0" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34115 } }
I20260807 22:42:25.594288 18234 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:25.594435 18234 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:25.594604 18234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:25.595983 18234 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1a0d4ed3db4893a389f482bc78e9a0" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34115 } }
I20260807 22:42:25.596295 18237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:25.594439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60379 (local address 127.26.52.126:34115)
0807 22:42:25.594559 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:25.594563 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:25.594861 (+ 298us) server_negotiation.cc:407] Connection header received
0807 22:42:25.595002 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:25.595004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:25.595035 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:25.595102 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:25.595815 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:25.595818 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:25.595820 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:42:25.595831 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:25.595857 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:42:25.595867 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:25.595938 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:25.596073 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 22:42:25.596163 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:42:25.596424 18234 leader_election.cc:302] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f1a0d4ed3db4893a389f482bc78e9a0; no voters:
I20260807 22:42:25.596810 18234 leader_election.cc:288] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:25.596915 18244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:25.597115 18244 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [term 1 LEADER]: Becoming Leader. State: Replica: 3f1a0d4ed3db4893a389f482bc78e9a0, State: Running, Role: LEADER
I20260807 22:42:25.597486 18244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1a0d4ed3db4893a389f482bc78e9a0" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34115 } }
I20260807 22:42:25.598114 18234 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:25.598735 18244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f1a0d4ed3db4893a389f482bc78e9a0. Latest consensus state: current_term: 1 leader_uuid: "3f1a0d4ed3db4893a389f482bc78e9a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1a0d4ed3db4893a389f482bc78e9a0" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34115 } } }
I20260807 22:42:25.598938 18244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:25.599220 18245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f1a0d4ed3db4893a389f482bc78e9a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1a0d4ed3db4893a389f482bc78e9a0" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 34115 } } }
I20260807 22:42:25.599396 18252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:25.599395 18245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:25.602689 18252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:25.608525 18252 catalog_manager.cc:1347] Generated new cluster ID: bcb5c28433ff47799ebcdfd62784da17
I20260807 22:42:25.608618 18252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:25.623080 18252 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:25.623509 18252 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:25.635371 18252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f1a0d4ed3db4893a389f482bc78e9a0: Generated new TSK 0
I20260807 22:42:25.636161 18252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:25.643612 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 18160
2026-08-07T22:42:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1458 ms)
[----------] 18 tests from AuthTokenIssuingTest (26735 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:25 dist-test-slave-8w9v krb5kdc[18265](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:25 dist-test-slave-8w9v krb5kdc[18265](info): set up 2 sockets
Aug 07 22:42:25 dist-test-slave-8w9v krb5kdc[18265](info): commencing operation
krb5kdc: starting...
W20260807 22:42:26.748605 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:26 dist-test-slave-8w9v krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:42:26.883301 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:45857
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:41353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:45857,127.26.52.125:36085,127.26.52.124:36311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:27.001199 18280 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:42:27.001598 18280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:27.001682 18280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:27.001771 18280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:27.005995 18280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:27.006109 18280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:27.006155 18280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:27.006197 18280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:27.006269 18280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:27.011821 18280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:41353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:45857,127.26.52.125:36085,127.26.52.124:36311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:45857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:27.013109 18280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:27.014236 18280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:27.023643 18287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:27.023684 18289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:27.023656 18286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:27.023849 18280 server_base.cc:1034] running on GCE node
I20260807 22:42:27.024593 18280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:27.025894 18280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:27.027130 18280 hybrid_clock.cc:648] HybridClock initialized: now 1786142547027103 us; error 52 us; skew 500 ppm
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:27.030200 18280 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:42:27.031131 18280 webserver.cc:460] Webserver started at http://127.26.52.126:36523/ using document root <none> and password file <none>
I20260807 22:42:27.031730 18280 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:27.031826 18280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:27.032079 18280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:27.034284 18280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "18142f65c52d49f99d0dacac0e8af6c5"
format_stamp: "Formatted at 2026-08-07 22:42:27 on dist-test-slave-8w9v"
server_key: "cb46f1b9de118a7a6f83df03a78e99f0"
server_key_iv: "7624143d2d9253a4f69bd58ed9f9543b"
server_key_version: "encryptionkey@0"
I20260807 22:42:27.034870 18280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "18142f65c52d49f99d0dacac0e8af6c5"
format_stamp: "Formatted at 2026-08-07 22:42:27 on dist-test-slave-8w9v"
server_key: "cb46f1b9de118a7a6f83df03a78e99f0"
server_key_iv: "7624143d2d9253a4f69bd58ed9f9543b"
server_key_version: "encryptionkey@0"
I20260807 22:42:27.038827 18280 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 22:42:27.041467 18296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:27.042706 18280 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:42:27.042857 18280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "18142f65c52d49f99d0dacac0e8af6c5"
format_stamp: "Formatted at 2026-08-07 22:42:27 on dist-test-slave-8w9v"
server_key: "cb46f1b9de118a7a6f83df03a78e99f0"
server_key_iv: "7624143d2d9253a4f69bd58ed9f9543b"
server_key_version: "encryptionkey@0"
I20260807 22:42:27.042992 18280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:27.068559 18280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:27.072003 18280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:27.072259 18280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:27.079841 18280 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:45857
I20260807 22:42:27.080206 18351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:45857 every 8 connection(s)
I20260807 22:42:27.080984 18280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:27.083984 18352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:27.087795 18352 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:27.091173 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 18280
I20260807 22:42:27.091333 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:27.091639 26833 external_mini_cluster.cc:1428] Setting key e16cdb93f43ba05045a9f5298da4b3da
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.52.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.125@KRBTEST.COM" created.
I20260807 22:42:27.105880 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.090188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:45857 (local address 127.0.0.1:60004)
0807 22:42:27.090825 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.090903 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:27.092054 (+ 1151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:27.092817 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:27.092826 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:27.093338 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:27.093760 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.093785 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.095566 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.095572 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.096914 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.096929 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.097668 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.097675 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.097843 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.098500 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:27.098528 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:27.100337 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:27.102563 (+ 2226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.102574 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.102583 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.102863 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.103235 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.103238 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.103240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.103382 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.104235 (+ 853us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:27.104241 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:27.104420 (+ 179us) client_negotiation.cc:769] Sending connection context
0807 22:42:27.104643 (+ 223us) client_negotiation.cc:240] Negotiation successful
0807 22:42:27.105009 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"spinlock_wait_cycles":24960,"thread_start_us":173,"threads_started":1}
I20260807 22:42:27.105885 18354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.090188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60004 (local address 127.26.52.126:45857)
0807 22:42:27.090767 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.090786 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.091047 (+ 261us) server_negotiation.cc:407] Connection header received
0807 22:42:27.092410 (+ 1363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.092414 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.092598 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.092751 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.093958 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.095429 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.097065 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.097478 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.097598 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.100494 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.100500 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.100510 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.100530 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.102398 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.102996 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.103001 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.103002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.103124 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.103518 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.103521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.103522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.104055 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.104263 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.104791 (+ 528us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.105149 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":100,"server-negotiator.queue_time_us":450,"thread_start_us":152,"threads_started":1}
I20260807 22:42:27.108578 18352 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:27.109582 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.109222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:36085 (local address 127.0.0.1:43354)
0807 22:42:27.109408 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.109501 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260807 22:42:27.109846 18298 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.52.125:36085: connect: Connection refused (error 111)
I20260807 22:42:27.110795 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.110550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:36085 (local address 127.0.0.1:43368)
0807 22:42:27.110680 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.110726 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 22:42:27.111009 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.125:36085: Network error: Client connection negotiation failed: client connection to 127.26.52.125:36085: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab.
Entry for principal kudu/127.26.52.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab.
I20260807 22:42:27.122983 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.125:36085
--webserver_interface=127.26.52.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab
--principal=kudu/127.26.52.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:41353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:45857,127.26.52.125:36085,127.26.52.124:36311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:42:27.160233 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } attempt: 1
I20260807 22:42:27.161247 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.160854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:36085 (local address 127.0.0.1:43384)
0807 22:42:27.161053 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.161141 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 22:42:27.162159 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.161852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:36085 (local address 127.0.0.1:43386)
0807 22:42:27.161996 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.162070 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 22:42:27.162319 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.125:36085: Network error: Client connection negotiation failed: client connection to 127.26.52.125:36085: connect: Connection refused (error 111)
I20260807 22:42:27.230513 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } attempt: 2
I20260807 22:42:27.231455 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.231104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:36085 (local address 127.0.0.1:43400)
0807 22:42:27.231284 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.231362 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 22:42:27.232252 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.231980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:36085 (local address 127.0.0.1:43416)
0807 22:42:27.232097 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.232186 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 22:42:27.232434 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.125:36085: Network error: Client connection negotiation failed: client connection to 127.26.52.125:36085: connect: Connection refused (error 111)
W20260807 22:42:27.247746 18359 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:42:27.248160 18359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:27.248234 18359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:27.248317 18359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:27.252655 18359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:27.252745 18359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:27.252782 18359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:27.252826 18359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:27.252864 18359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:27.258368 18359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:41353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:45857,127.26.52.125:36085,127.26.52.124:36311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab
--principal=kudu/127.26.52.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.125:36085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.52.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:27.259653 18359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:27.260761 18359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:27.269867 18364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:27.269882 18365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:27.269922 18368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:27.269938 18359 server_base.cc:1034] running on GCE node
I20260807 22:42:27.270748 18359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:27.271960 18359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:27.273126 18359 hybrid_clock.cc:648] HybridClock initialized: now 1786142547273090 us; error 51 us; skew 500 ppm
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:27.275995 18359 init.cc:377] Logged in from keytab as kudu/127.26.52.125@KRBTEST.COM (short username kudu)
I20260807 22:42:27.276979 18359 webserver.cc:460] Webserver started at http://127.26.52.125:39913/ using document root <none> and password file <none>
I20260807 22:42:27.277585 18359 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:27.277648 18359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:27.277937 18359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:27.280184 18359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/data/instance:
uuid: "9200f3cc908e4dce997821df2b571af4"
format_stamp: "Formatted at 2026-08-07 22:42:27 on dist-test-slave-8w9v"
server_key: "a02dd2ce61775e55477ae95de9983948"
server_key_iv: "a56439059b52e499d691574c414717a2"
server_key_version: "encryptionkey@0"
I20260807 22:42:27.280777 18359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/wal/instance:
uuid: "9200f3cc908e4dce997821df2b571af4"
format_stamp: "Formatted at 2026-08-07 22:42:27 on dist-test-slave-8w9v"
server_key: "a02dd2ce61775e55477ae95de9983948"
server_key_iv: "a56439059b52e499d691574c414717a2"
server_key_version: "encryptionkey@0"
I20260807 22:42:27.284766 18359 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 22:42:27.287215 18376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:27.288518 18359 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 22:42:27.288676 18359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/wal
uuid: "9200f3cc908e4dce997821df2b571af4"
format_stamp: "Formatted at 2026-08-07 22:42:27 on dist-test-slave-8w9v"
server_key: "a02dd2ce61775e55477ae95de9983948"
server_key_iv: "a56439059b52e499d691574c414717a2"
server_key_version: "encryptionkey@0"
I20260807 22:42:27.288800 18359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:27.309583 18359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:27.313016 18359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:27.313247 18359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:27.320698 18359 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.125:36085
I20260807 22:42:27.320987 18431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.125:36085 every 8 connection(s)
I20260807 22:42:27.321805 18359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
I20260807 22:42:27.323642 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } attempt: 3
I20260807 22:42:27.325842 18432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:27.329901 18432 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:27.331022 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 18359
I20260807 22:42:27.331172 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-1/wal/instance
I20260807 22:42:27.331489 26833 external_mini_cluster.cc:1428] Setting key 8a07f8e44b5d747f6d50c377c3b21362
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
I20260807 22:42:27.337812 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.324271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:36085 (local address 127.0.0.1:43422)
0807 22:42:27.324412 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.324429 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:27.324536 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:27.326792 (+ 2256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:27.326795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:27.327013 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:27.327156 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.327165 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.328556 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.328560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.329099 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.329108 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.329857 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.329861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.329974 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.330574 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:27.330587 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:27.332268 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:27.335583 (+ 3315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.335589 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.335594 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.335883 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.336400 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.336414 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.336419 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.336541 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.337262 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:27.337265 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:27.337375 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 22:42:27.337491 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 22:42:27.337638 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 22:42:27.338948 18434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.324903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43422 (local address 127.26.52.125:36085)
0807 22:42:27.325345 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.325362 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.325400 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:42:27.326152 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.326171 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.326505 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.326863 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.327324 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.328421 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.329229 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.329713 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.329891 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.332516 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.332525 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.332543 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.332580 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.335442 (+ 2862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.336034 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.336041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.336050 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.336263 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.336656 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.336660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.336662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.337148 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.337295 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.337646 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.337971 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":122,"threads_started":1}
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:42:27.341150 18352 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:27.341918 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.341643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38490)
0807 22:42:27.341768 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.341830 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
WARNING: no policy specified for kudu/127.26.52.124@KRBTEST.COM; defaulting to no policy
I20260807 22:42:27.342747 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.342489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38500)
0807 22:42:27.342632 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.342688 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260807 22:42:27.342980 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:36311: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
I20260807 22:42:27.344000 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.331878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:45857 (local address 127.0.0.1:60006)
0807 22:42:27.332410 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.332469 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:27.332619 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:27.332983 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:27.332990 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:27.333489 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:27.333667 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.333677 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.334454 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.334460 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.335470 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.335482 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.336924 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.336931 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.337102 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.337681 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:27.337701 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:27.339762 (+ 2061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:27.341952 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.341964 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.341970 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.342275 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.342839 (+ 564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.342845 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.342849 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.342954 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.343381 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:27.343388 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:27.343515 (+ 127us) client_negotiation.cc:769] Sending connection context
0807 22:42:27.343683 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 22:42:27.343848 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":116,"threads_started":1}
I20260807 22:42:27.344067 18354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.331956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60006 (local address 127.26.52.126:45857)
0807 22:42:27.332091 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.332095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.332536 (+ 441us) server_negotiation.cc:407] Connection header received
0807 22:42:27.332744 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.332749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.332811 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.332897 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.333809 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.334332 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.335614 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.336675 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.336787 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.339932 (+ 3145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.339936 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.339942 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.339972 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.341830 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.342641 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.342644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.342646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.342725 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.343053 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.343058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.343059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.343266 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.343381 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.343848 (+ 467us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.343951 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:42:27.345178 18432 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.124@KRBTEST.COM" created.
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
I20260807 22:42:27.354621 18434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.345895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43432 (local address 127.26.52.125:36085)
0807 22:42:27.346011 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.346015 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.346028 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:42:27.346063 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.346067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.346113 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.346187 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.346700 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.347323 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.348418 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.348798 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.348927 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.351207 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.351212 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.351215 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.351244 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.352792 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.353304 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.353307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.353308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.353380 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.353683 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.353685 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.353686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.353861 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.353945 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.354252 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.354467 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":103,"server-negotiator.queue_time_us":37}
I20260807 22:42:27.354632 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.345709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:36085 (local address 127.0.0.1:43432)
0807 22:42:27.345841 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.345856 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:27.345935 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:27.346238 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:27.346241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:27.346432 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:27.346581 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.346591 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.347429 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.347436 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.348302 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.348312 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.348956 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.348961 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.349158 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.349800 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:27.349813 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:27.351060 (+ 1247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:27.352909 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.352915 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.352920 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.353194 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.353474 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.353479 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.353481 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.353587 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.353961 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:27.353964 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:27.354075 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 22:42:27.354206 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 22:42:27.354393 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 22:42:27.356274 18432 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:27.357092 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.356794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38512)
0807 22:42:27.356925 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.357004 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 22:42:27.357362 18380 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
I20260807 22:42:27.358294 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.358066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38516)
0807 22:42:27.358182 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.358237 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 22:42:27.358448 18432 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:36311: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab.
Entry for principal kudu/127.26.52.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab.
I20260807 22:42:27.363862 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.124:36311
--webserver_interface=127.26.52.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab
--principal=kudu/127.26.52.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:41353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:45857,127.26.52.125:36085,127.26.52.124:36311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:42:27.374166 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } attempt: 1
I20260807 22:42:27.375133 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.374816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38526)
0807 22:42:27.374988 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.375050 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 22:42:27.375905 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.375676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38532)
0807 22:42:27.375792 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.375845 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 22:42:27.376057 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:36311: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
I20260807 22:42:27.407856 18432 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } attempt: 1
I20260807 22:42:27.409256 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.408649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38546)
0807 22:42:27.408915 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.409074 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 22:42:27.410466 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.410174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38558)
0807 22:42:27.410307 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.410385 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260807 22:42:27.411123 18432 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:36311: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
I20260807 22:42:27.451268 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } attempt: 2
I20260807 22:42:27.452208 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.451833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38566)
0807 22:42:27.452000 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.452071 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 22:42:27.452996 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.452772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38582)
0807 22:42:27.452885 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.452933 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 22:42:27.453188 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:36311: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
I20260807 22:42:27.479295 18432 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } attempt: 2
I20260807 22:42:27.480204 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.479827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38596)
0807 22:42:27.479988 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.480071 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 22:42:27.480929 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.480701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38606)
0807 22:42:27.480813 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.480860 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 22:42:27.481060 18432 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:36311: Network error: Client connection negotiation failed: client connection to 127.26.52.124:36311: connect: Connection refused (error 111)
W20260807 22:42:27.483388 18439 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:42:27.483721 18439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:27.483793 18439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:27.483897 18439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:27.488108 18439 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:27.488262 18439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:27.488301 18439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:27.488336 18439 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:27.488372 18439 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:27.494117 18439 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:41353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:45857,127.26.52.125:36085,127.26.52.124:36311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab
--principal=kudu/127.26.52.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.124:36311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.52.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:27.495302 18439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:27.496457 18439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:27.505100 18445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:27.505100 18444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:27.505328 18439 server_base.cc:1034] running on GCE node
W20260807 22:42:27.505100 18447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:27.506088 18439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:27.507310 18439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:27.508499 18439 hybrid_clock.cc:648] HybridClock initialized: now 1786142547508487 us; error 26 us; skew 500 ppm
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:27.511304 18439 init.cc:377] Logged in from keytab as kudu/127.26.52.124@KRBTEST.COM (short username kudu)
I20260807 22:42:27.512312 18439 webserver.cc:460] Webserver started at http://127.26.52.124:46289/ using document root <none> and password file <none>
I20260807 22:42:27.512903 18439 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:27.513001 18439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:27.513244 18439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:27.515323 18439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/data/instance:
uuid: "830158ee3ac14c5aae2b54f9d30062b1"
format_stamp: "Formatted at 2026-08-07 22:42:27 on dist-test-slave-8w9v"
server_key: "cc9a6fe0647ea1f56d0c2e30ac8d9fdf"
server_key_iv: "b976e9528c37ecbb109f1ad59e4c8eb0"
server_key_version: "encryptionkey@0"
I20260807 22:42:27.515906 18439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/wal/instance:
uuid: "830158ee3ac14c5aae2b54f9d30062b1"
format_stamp: "Formatted at 2026-08-07 22:42:27 on dist-test-slave-8w9v"
server_key: "cc9a6fe0647ea1f56d0c2e30ac8d9fdf"
server_key_iv: "b976e9528c37ecbb109f1ad59e4c8eb0"
server_key_version: "encryptionkey@0"
I20260807 22:42:27.519763 18439 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:42:27.522298 18456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:27.523530 18439 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:42:27.523672 18439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/wal
uuid: "830158ee3ac14c5aae2b54f9d30062b1"
format_stamp: "Formatted at 2026-08-07 22:42:27 on dist-test-slave-8w9v"
server_key: "cc9a6fe0647ea1f56d0c2e30ac8d9fdf"
server_key_iv: "b976e9528c37ecbb109f1ad59e4c8eb0"
server_key_version: "encryptionkey@0"
I20260807 22:42:27.523787 18439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:27.539301 18439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:27.542940 18439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:27.543171 18439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:27.550676 18439 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.124:36311
I20260807 22:42:27.551008 18512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.124:36311 every 8 connection(s)
I20260807 22:42:27.551741 18439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
I20260807 22:42:27.552347 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } attempt: 3
I20260807 22:42:27.555135 18514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:27.559736 18514 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:42:27.561666 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 18439
I20260807 22:42:27.561818 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142258649536-26833-0/minicluster-data/master-2/wal/instance
I20260807 22:42:27.562245 26833 external_mini_cluster.cc:1428] Setting key e6b045ca4e548bdf4726041a86a7b5f5
I20260807 22:42:27.566816 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.552891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38616)
0807 22:42:27.553056 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.553075 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:27.553180 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:27.555651 (+ 2471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:27.555654 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:27.555826 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:27.555933 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.555938 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.557765 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.557769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.558311 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.558320 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.559231 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.559234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.559329 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.559871 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:27.559884 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:27.561296 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:27.564827 (+ 3531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.564831 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.564833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.565086 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.565468 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.565471 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.565473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.565573 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.566297 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:27.566300 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:27.566392 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 22:42:27.566507 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 22:42:27.566637 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:42:27.568883 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.553550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38616 (local address 127.26.52.124:36311)
0807 22:42:27.553966 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.553985 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.554028 (+ 43us) server_negotiation.cc:407] Connection header received
0807 22:42:27.554887 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.554910 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.555311 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.555669 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.556100 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.557617 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.558445 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.559106 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.559286 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.561552 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.561559 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.561576 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.561613 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.564697 (+ 3084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.565235 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.565240 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.565244 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.565349 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.565681 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.565685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.565687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.566147 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.567376 (+ 1229us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.567555 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.567844 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":120,"threads_started":1}
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:42:27.572185 18432 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } attempt: 3
I20260807 22:42:27.573493 18517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.561535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:45857 (local address 127.0.0.1:60016)
0807 22:42:27.561942 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.561991 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:27.562122 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:27.562452 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:27.562458 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:27.562870 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:27.563045 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.563054 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.564053 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.564057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.565097 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.565108 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.565677 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.565681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.565795 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.566363 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:27.566380 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:27.568101 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:27.571506 (+ 3405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.571516 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.571521 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.571824 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.572116 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.572149 (+ 33us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.572151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.572245 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.572845 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:27.572854 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:27.572978 (+ 124us) client_negotiation.cc:769] Sending connection context
0807 22:42:27.573120 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 22:42:27.573307 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":116,"threads_started":1}
I20260807 22:42:27.573526 18354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.561557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60016 (local address 127.26.52.126:45857)
0807 22:42:27.561693 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.561697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.562083 (+ 386us) server_negotiation.cc:407] Connection header received
0807 22:42:27.562221 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.562224 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.562276 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.562362 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.563179 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.563924 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.565224 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.565558 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.565669 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.568270 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.568274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.568277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.568301 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.571090 (+ 2789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.571935 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.571938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.571939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.572015 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.572396 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.572399 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.572401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.572679 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.572752 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.573224 (+ 472us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.573361 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:42:27.574361 18352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5: Bootstrap starting.
I20260807 22:42:27.574949 18514 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:27.575002 18518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.562890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38632 (local address 127.26.52.124:36311)
0807 22:42:27.563185 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.563194 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.563591 (+ 397us) server_negotiation.cc:407] Connection header received
0807 22:42:27.563627 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.563629 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.563666 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.563738 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.564713 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.565300 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.566470 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.566803 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.566909 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.569865 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.569869 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.569871 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.569899 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.572906 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.573417 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.573420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.573422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.573516 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.573995 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.574001 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.574002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.574219 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.574388 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.574722 (+ 334us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.574839 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":114,"threads_started":1}
I20260807 22:42:27.578387 18352 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:27.579397 18352 log.cc:824] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5: Log is configured to *not* fsync() on all Append() calls
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
I20260807 22:42:27.582168 18352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5: No bootstrap required, opened a new log
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:42:27.584956 18517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.575448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:36085 (local address 127.0.0.1:43440)
0807 22:42:27.575669 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.575684 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:27.575769 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:27.576033 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:27.576035 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:27.576235 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:27.576332 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.576337 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.577291 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.577294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.578149 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.578158 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.578683 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.578686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.578782 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.579315 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:27.579330 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:27.580940 (+ 1610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:27.582767 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.582772 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.582778 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.583062 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.583746 (+ 684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.583749 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.583751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.583838 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.584391 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:27.584395 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:27.584504 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 22:42:27.584623 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 22:42:27.584771 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150}
I20260807 22:42:27.585017 18434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.575537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43440 (local address 127.26.52.125:36085)
0807 22:42:27.575667 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.575670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.575726 (+ 56us) server_negotiation.cc:407] Connection header received
0807 22:42:27.575868 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.575871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.575920 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.576023 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.576506 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.577160 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.578263 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.578557 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.578682 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.581122 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.581126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.581128 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.581152 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.582653 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.583496 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.583502 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.583507 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.583613 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.583955 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.583959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.583961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.584205 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.584302 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.584723 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.584846 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:42:27.586174 18514 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:27.586732 18352 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } }
I20260807 22:42:27.586992 18352 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18142f65c52d49f99d0dacac0e8af6c5, State: Initialized, Role: FOLLOWER
I20260807 22:42:27.587363 18352 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } }
I20260807 22:42:27.587993 18521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } } }
I20260807 22:42:27.588204 18521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:27.589026 18352 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:27.590332 18354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.577071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60032 (local address 127.26.52.126:45857)
0807 22:42:27.577172 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.577176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.577188 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:42:27.577222 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.577225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.577262 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.577339 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.578098 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.578815 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.579916 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.580283 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.580369 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.586401 (+ 6032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.586408 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.586412 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.586444 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.588200 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.588667 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.588672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.588675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.588770 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.589122 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.589127 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.589130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.589396 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.589593 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.590005 (+ 412us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.590140 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:42:27.591302 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.572648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38646)
0807 22:42:27.575341 (+ 2693us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.575355 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:27.575429 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:27.580193 (+ 4764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:27.580197 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:27.580390 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:27.580487 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.580494 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.581549 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.581552 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.582292 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.582303 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.582898 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.582901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.582992 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.583471 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:27.583484 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:27.585401 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:27.589569 (+ 4168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.589572 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.589575 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.589858 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.590185 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.590188 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.590190 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.590276 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.590721 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:27.590725 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:27.590852 (+ 127us) client_negotiation.cc:769] Sending connection context
0807 22:42:27.590945 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 22:42:27.591094 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2610}
I20260807 22:42:27.592378 18518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.575604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38646 (local address 127.26.52.124:36311)
0807 22:42:27.579884 (+ 4280us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.579888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.579903 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:42:27.579952 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.579958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.580003 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.580605 (+ 602us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.580689 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.581408 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.582442 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.582763 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.583200 (+ 437us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.586027 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.586031 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.586034 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.586058 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.589441 (+ 3383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.589987 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.589990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.589992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.590072 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.590396 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.590399 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.590400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.590599 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.591686 (+ 1087us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.592051 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.592218 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4204}
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:42:27.595783 18432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4: Bootstrap starting.
I20260807 22:42:27.597321 18517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.586639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:36311 (local address 127.0.0.1:38660)
0807 22:42:27.586997 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:27.587014 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:27.587091 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:27.587400 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:27.587403 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:27.587690 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:27.587789 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.587796 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.588902 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.588917 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.589698 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:27.589711 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.590667 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.590674 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:27.590781 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.591301 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:27.591319 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:27.593463 (+ 2144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:27.595745 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.595748 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.595750 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.596068 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.596370 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:27.596375 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:27.596378 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:27.596448 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:27.596845 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:27.596848 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:27.596931 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 22:42:27.597021 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:42:27.597151 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268}
I20260807 22:42:27.597950 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.586870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38660 (local address 127.26.52.124:36311)
0807 22:42:27.587148 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.587152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.587166 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:42:27.587198 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.587201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.587237 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.587310 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.587916 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.588781 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.589829 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.590202 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.590292 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.593592 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.593596 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.593600 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.593621 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.595635 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.596204 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.596208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.596209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.596281 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.596544 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.596547 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.596548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.596729 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.596815 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.597689 (+ 874us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.597812 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165}
I20260807 22:42:27.594683 18280 master_runner.cc:186] Error getting master registration for 127.26.52.125:36085: OK, instance_id { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" instance_seqno: 1786142547318636 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
Aug 07 22:42:27 dist-test-slave-8w9v krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
I20260807 22:42:27.599104 18280 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:42:27.599643 18432 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:27.600662 18432 log.cc:824] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:27.600724 18514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1: Bootstrap starting.
I20260807 22:42:27.602985 18432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4: No bootstrap required, opened a new log
I20260807 22:42:27.603356 18434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.592331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43454 (local address 127.26.52.125:36085)
0807 22:42:27.592454 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.592458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.592810 (+ 352us) server_negotiation.cc:407] Connection header received
0807 22:42:27.592999 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.593002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.593049 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.593098 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.594303 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.595278 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.596360 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.596651 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.596723 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.599630 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.599634 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.599636 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.599663 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.601394 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.601925 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.601928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.601930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.602015 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.602342 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.602345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.602347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.602558 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.602703 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.603089 (+ 386us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.603206 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:42:27.603354 18514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:27.604475 18514 log.cc:824] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1: Log is configured to *not* fsync() on all Append() calls
W20260807 22:42:27.604789 18533 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:42:27.604875 18533 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:27.606689 18514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1: No bootstrap required, opened a new log
I20260807 22:42:27.607156 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:27.607939 18432 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } }
I20260807 22:42:27.608192 18432 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9200f3cc908e4dce997821df2b571af4, State: Initialized, Role: FOLLOWER
I20260807 22:42:27.608551 18432 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } }
I20260807 22:42:27.608732 18325 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "18142f65c52d49f99d0dacac0e8af6c5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60032
I20260807 22:42:27.609072 18325 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 22:42:27.609184 18325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:27.610183 18432 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:27.610985 18325 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } }
I20260807 22:42:27.611472 18514 raft_consensus.cc:348] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } }
I20260807 22:42:27.611749 18514 raft_consensus.cc:729] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830158ee3ac14c5aae2b54f9d30062b1, State: Initialized, Role: FOLLOWER
I20260807 22:42:27.612102 18514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } }
I20260807 22:42:27.612648 18404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18142f65c52d49f99d0dacac0e8af6c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9200f3cc908e4dce997821df2b571af4"
I20260807 22:42:27.612771 18325 leader_election.cc:288] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [CANDIDATE]: Term 1 election: Requested vote from peers 9200f3cc908e4dce997821df2b571af4 (127.26.52.125:36085), 830158ee3ac14c5aae2b54f9d30062b1 (127.26.52.124:36311)
I20260807 22:42:27.612918 18404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:27.614332 18404 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18142f65c52d49f99d0dacac0e8af6c5 in term 1.
I20260807 22:42:27.614667 18485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18142f65c52d49f99d0dacac0e8af6c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "830158ee3ac14c5aae2b54f9d30062b1"
I20260807 22:42:27.614807 18298 leader_election.cc:302] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18142f65c52d49f99d0dacac0e8af6c5, 9200f3cc908e4dce997821df2b571af4; no voters:
I20260807 22:42:27.614928 18485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:27.615136 18521 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:27.615361 18521 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [term 1 LEADER]: Becoming Leader. State: Replica: 18142f65c52d49f99d0dacac0e8af6c5, State: Running, Role: LEADER
I20260807 22:42:27.615716 18521 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } }
I20260807 22:42:27.616233 18514 sys_catalog.cc:564] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:27.617451 18485 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18142f65c52d49f99d0dacac0e8af6c5 in term 1.
I20260807 22:42:27.617982 18521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18142f65c52d49f99d0dacac0e8af6c5. Latest consensus state: current_term: 1 leader_uuid: "18142f65c52d49f99d0dacac0e8af6c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } } }
I20260807 22:42:27.618110 18521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:27.618564 18560 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:27.621512 18560 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260807 22:42:27.622283 18565 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:42:27.622375 18565 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:27.623109 18538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } } }
I20260807 22:42:27.623260 18538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 22:42:27.627604 18569 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:42:27.627839 18569 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:27.632294 18547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } } }
I20260807 22:42:27.632475 18547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:27.640273 18434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.624373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43470 (local address 127.26.52.125:36085)
0807 22:42:27.624509 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.624515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.628629 (+ 4114us) server_negotiation.cc:407] Connection header received
0807 22:42:27.628878 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.628882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.628941 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.629005 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.630737 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.631552 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.633034 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.633412 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.633510 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.635749 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.635755 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.635758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.635790 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.637857 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.638489 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.638493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.638496 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.638602 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.638997 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.639002 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.639004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.639277 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.639427 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.639874 (+ 447us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.640018 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:42:27.646044 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.622821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38670 (local address 127.26.52.124:36311)
0807 22:42:27.622935 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.622940 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.627357 (+ 4417us) server_negotiation.cc:407] Connection header received
0807 22:42:27.627597 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.627601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.627652 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.627704 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.628851 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.629651 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.630882 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.631227 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.631319 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.638127 (+ 6808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.638133 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.638138 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.638171 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.639969 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.644574 (+ 4605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.644578 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.644580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.644674 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.645041 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.645045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.645046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.645266 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.645400 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.645743 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.645876 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 22:42:27.649186 18485 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [term 1 FOLLOWER]: Refusing update from remote peer 18142f65c52d49f99d0dacac0e8af6c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:42:27.650465 18404 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [term 1 FOLLOWER]: Refusing update from remote peer 18142f65c52d49f99d0dacac0e8af6c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:42:27.651892 18521 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:42:27.652027 18354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:27.624834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60042 (local address 127.26.52.126:45857)
0807 22:42:27.624956 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.624960 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.632433 (+ 7473us) server_negotiation.cc:407] Connection header received
0807 22:42:27.632640 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.632646 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.632709 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.632769 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.633750 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.634514 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.635666 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:27.636030 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:27.636110 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:27.648101 (+ 11991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:27.648105 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:27.648108 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:27.648171 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:27.649948 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.650475 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.650481 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.650485 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.650580 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:27.650933 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:27.650936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:27.650938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:27.651184 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:27.651302 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:27.651707 (+ 405us) server_negotiation.cc:299] Negotiation successful
0807 22:42:27.651837 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:42:27.652621 18521 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:42:27.656693 18547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18142f65c52d49f99d0dacac0e8af6c5. Latest consensus state: current_term: 1 leader_uuid: "18142f65c52d49f99d0dacac0e8af6c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } } }
I20260807 22:42:27.656838 18547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:27.657924 18538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18142f65c52d49f99d0dacac0e8af6c5. Latest consensus state: current_term: 1 leader_uuid: "18142f65c52d49f99d0dacac0e8af6c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } } }
I20260807 22:42:27.658056 18538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:27.665548 18552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "18142f65c52d49f99d0dacac0e8af6c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } } }
I20260807 22:42:27.665704 18552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:27.665866 18538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18142f65c52d49f99d0dacac0e8af6c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } } }
I20260807 22:42:27.665982 18538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:27.666100 18573 mvcc.cc:205] Tried to move back new op lower bound from 7316039875161571328 to 7316039875038748672. Current Snapshot: MvccSnapshot[applied={T|T < 7316039875161571328}]
I20260807 22:42:27.671186 18579 mvcc.cc:205] Tried to move back new op lower bound from 7316039875161571328 to 7316039875038748672. Current Snapshot: MvccSnapshot[applied={T|T < 7316039875161571328}]
I20260807 22:42:27.673909 18552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "18142f65c52d49f99d0dacac0e8af6c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } } }
I20260807 22:42:27.674067 18552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:27.675348 18547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18142f65c52d49f99d0dacac0e8af6c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18142f65c52d49f99d0dacac0e8af6c5" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 45857 } } peers { permanent_uuid: "9200f3cc908e4dce997821df2b571af4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 36085 } } peers { permanent_uuid: "830158ee3ac14c5aae2b54f9d30062b1" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 36311 } } }
I20260807 22:42:27.675474 18547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:27.678164 18560 catalog_manager.cc:1347] Generated new cluster ID: 66ac39de37f1481daa39e0eb38fa2132
I20260807 22:42:27.678244 18560 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:27.699426 18560 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:27.700870 18560 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:27.730278 18560 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18142f65c52d49f99d0dacac0e8af6c5: Generated new TSK 0
I20260807 22:42:27.731348 18560 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:42:27.779166 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.775954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43482 (local address 127.26.52.125:36085)
0807 22:42:27.776188 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.776195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.777989 (+ 1794us) server_negotiation.cc:407] Connection header received
0807 22:42:27.778206 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.778210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.778264 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.778332 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.779022 (+ 690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43482: BlockingRecv error: recv got EOF from 127.0.0.1:43482 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 22:42:27.780814 18516 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.776932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38672 (local address 127.26.52.124:36311)
0807 22:42:27.777086 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.777091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.779868 (+ 2777us) server_negotiation.cc:407] Connection header received
0807 22:42:27.780045 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.780049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.780096 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.780175 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.780692 (+ 517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38672: BlockingRecv error: recv got EOF from 127.0.0.1:38672 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260807 22:42:27.782351 18354 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.776447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60056 (local address 127.26.52.126:45857)
0807 22:42:27.776566 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.776571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.781455 (+ 4884us) server_negotiation.cc:407] Connection header received
0807 22:42:27.781632 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.781636 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.781689 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.781742 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.782218 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60056: BlockingRecv error: recv got EOF from 127.0.0.1:60056 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 22:42:27.787546 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.785706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43492 (local address 127.26.52.125:36085)
0807 22:42:27.785832 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.785836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.786399 (+ 563us) server_negotiation.cc:407] Connection header received
0807 22:42:27.786622 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.786641 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.786730 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.786786 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.787413 (+ 627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43492: BlockingRecv error: recv got EOF from 127.0.0.1:43492 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 22:42:27.793370 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.791342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43494 (local address 127.26.52.125:36085)
0807 22:42:27.791456 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.791460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.792178 (+ 718us) server_negotiation.cc:407] Connection header received
0807 22:42:27.792401 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.792404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.792478 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.792534 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.793215 (+ 681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43494: BlockingRecv error: recv got EOF from 127.0.0.1:43494 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 22:42:27.799690 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.797912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43502 (local address 127.26.52.125:36085)
0807 22:42:27.798021 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.798025 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.798632 (+ 607us) server_negotiation.cc:407] Connection header received
0807 22:42:27.798839 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.798844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.798904 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.798963 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.799567 (+ 604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43502: BlockingRecv error: recv got EOF from 127.0.0.1:43502 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 22:42:27.808341 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.806485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43512 (local address 127.26.52.125:36085)
0807 22:42:27.806641 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.806647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.807242 (+ 595us) server_negotiation.cc:407] Connection header received
0807 22:42:27.807462 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.807466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.807522 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.807576 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.808214 (+ 638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43512: BlockingRecv error: recv got EOF from 127.0.0.1:43512 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 22:42:27.821465 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.819385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43526 (local address 127.26.52.125:36085)
0807 22:42:27.819520 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.819525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.820301 (+ 776us) server_negotiation.cc:407] Connection header received
0807 22:42:27.820560 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.820564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.820626 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.820687 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.821331 (+ 644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43526: BlockingRecv error: recv got EOF from 127.0.0.1:43526 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 22:42:27.842239 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.840404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43532 (local address 127.26.52.125:36085)
0807 22:42:27.840541 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.840546 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.841157 (+ 611us) server_negotiation.cc:407] Connection header received
0807 22:42:27.841383 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.841387 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.841444 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.841498 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.842093 (+ 595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43532: BlockingRecv error: recv got EOF from 127.0.0.1:43532 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 22:42:27.878494 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.877049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43538 (local address 127.26.52.125:36085)
0807 22:42:27.877191 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.877195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.877478 (+ 283us) server_negotiation.cc:407] Connection header received
0807 22:42:27.877667 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.877671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.877725 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.877817 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.878343 (+ 526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43538: BlockingRecv error: recv got EOF from 127.0.0.1:43538 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 22:42:27.946638 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:27.945276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43540 (local address 127.26.52.125:36085)
0807 22:42:27.945475 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:27.945482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:27.945717 (+ 235us) server_negotiation.cc:407] Connection header received
0807 22:42:27.945877 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:27.945880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:27.945934 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:27.946027 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:27.946533 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43540: BlockingRecv error: recv got EOF from 127.0.0.1:43540 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
W20260807 22:42:28.078469 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:28.077110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43542 (local address 127.26.52.125:36085)
0807 22:42:28.077251 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:28.077254 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:28.077423 (+ 169us) server_negotiation.cc:407] Connection header received
0807 22:42:28.077645 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:28.077648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:28.077702 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:28.077790 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:28.078336 (+ 546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43542: BlockingRecv error: recv got EOF from 127.0.0.1:43542 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 22:42:28.337845 18434 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:28.336628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43556 (local address 127.26.52.125:36085)
0807 22:42:28.336782 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:28.336786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:28.336896 (+ 110us) server_negotiation.cc:407] Connection header received
0807 22:42:28.337080 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:28.337083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:28.337133 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:28.337226 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:28.337708 (+ 482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43556: BlockingRecv error: recv got EOF from 127.0.0.1:43556 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:42:28.623708 18565 catalog_manager.cc:1259] Loaded cluster ID: 66ac39de37f1481daa39e0eb38fa2132
I20260807 22:42:28.623792 18565 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4: loading cluster ID for follower catalog manager: success
I20260807 22:42:28.625530 18565 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4: acquiring CA information for follower catalog manager: success
I20260807 22:42:28.626706 18565 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9200f3cc908e4dce997821df2b571af4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:42:28.629025 18569 catalog_manager.cc:1259] Loaded cluster ID: 66ac39de37f1481daa39e0eb38fa2132
I20260807 22:42:28.629086 18569 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1: loading cluster ID for follower catalog manager: success
I20260807 22:42:28.630594 18569 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1: acquiring CA information for follower catalog manager: success
I20260807 22:42:28.631665 18569 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 830158ee3ac14c5aae2b54f9d30062b1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:42:28.856235 18653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:28.852188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43564 (local address 127.26.52.125:36085)
0807 22:42:28.852438 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:28.852442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:28.852460 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:42:28.852609 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:28.852611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:28.852741 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:28.852850 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:28.853162 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:28.853729 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:28.854663 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:28.854926 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:28.855012 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:28.855328 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:28.855794 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:28.855890 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:28.855969 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 22:42:28.856023 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":88,"threads_started":1}
I20260807 22:42:28.863261 18661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:28.859644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38680 (local address 127.26.52.124:36311)
0807 22:42:28.859899 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:28.859903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:28.859917 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:42:28.860004 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:28.860006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:28.860191 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:28.860309 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:28.860517 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:28.861040 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:28.861826 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:28.862064 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:28.862143 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:28.862456 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:28.862899 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:28.862990 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:28.863082 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 22:42:28.863134 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":76,"threads_started":1}
I20260807 22:42:28.870821 18661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:28.866604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38694 (local address 127.26.52.124:36311)
0807 22:42:28.866722 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:28.866729 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:28.867070 (+ 341us) server_negotiation.cc:407] Connection header received
0807 22:42:28.867177 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:28.867181 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:28.867234 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:28.867344 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:28.867590 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:28.868399 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:28.869549 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:28.869873 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:28.869976 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:28.870252 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:28.870337 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:28.870399 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:28.870588 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 22:42:28.870652 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:42:28.871033 18653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:28.866719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43568 (local address 127.26.52.125:36085)
0807 22:42:28.866844 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:28.866848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:28.867168 (+ 320us) server_negotiation.cc:407] Connection header received
0807 22:42:28.867363 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:28.867366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:28.867441 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:28.867511 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:28.867870 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:28.868655 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:28.869791 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:28.870102 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:28.870215 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:28.870505 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:28.870612 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:28.870683 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:28.870831 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 22:42:28.870898 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:42:28.871650 18669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:28.866548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60070 (local address 127.26.52.126:45857)
0807 22:42:28.866926 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:28.866929 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:28.866944 (+ 15us) server_negotiation.cc:407] Connection header received
0807 22:42:28.867198 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:28.867200 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:28.867356 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:28.867484 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:28.867691 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:28.868452 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:28.869673 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:28.870025 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:28.870145 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:28.870532 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:28.871028 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:28.871109 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:28.871425 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 22:42:28.871497 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":76,"threads_started":1}
I20260807 22:42:28.875113 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 18280
I20260807 22:42:28.884922 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 18359
I20260807 22:42:28.894094 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 18439
2026-08-07T22:42:28Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3250 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:28 dist-test-slave-8w9v krb5kdc[18672](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:28 dist-test-slave-8w9v krb5kdc[18672](info): set up 2 sockets
Aug 07 22:42:28 dist-test-slave-8w9v krb5kdc[18672](info): commencing operation
krb5kdc: starting...
W20260807 22:42:29.979477 26833 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/test-user.keytab.
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.52.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
Entry for principal kudu/127.26.52.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab.
I20260807 22:42:30.113613 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:46373
--webserver_interface=127.26.52.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:46373,127.26.52.125:40201,127.26.52.124:41247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:30.228739 18688 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:42:30.229104 18688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:30.229192 18688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:30.229295 18688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:30.233443 18688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:30.233532 18688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:30.233572 18688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:30.233609 18688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:30.233641 18688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:30.239092 18688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:46373,127.26.52.125:40201,127.26.52.124:41247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.126.keytab
--principal=kudu/127.26.52.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.126:46373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.52.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:30.240398 18688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:30.241503 18688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:30.250536 18693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:30.250610 18696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:30.250598 18688 server_base.cc:1034] running on GCE node
W20260807 22:42:30.250536 18694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:30.251457 18688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:30.252630 18688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:30.253803 18688 hybrid_clock.cc:648] HybridClock initialized: now 1786142550253769 us; error 44 us; skew 500 ppm
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:30.256884 18688 init.cc:377] Logged in from keytab as kudu/127.26.52.126@KRBTEST.COM (short username kudu)
I20260807 22:42:30.257869 18688 webserver.cc:460] Webserver started at http://127.26.52.126:40199/ using document root <none> and password file <none>
I20260807 22:42:30.258488 18688 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:30.258587 18688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:30.258837 18688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:30.261072 18688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/data/instance:
uuid: "bb94052ccceb4b36a93d2764c77b2241"
format_stamp: "Formatted at 2026-08-07 22:42:30 on dist-test-slave-8w9v"
server_key: "b815d3efaff35519f37700b08e5b646d"
server_key_iv: "4d732c605a13ed3f21630d209ce8e404"
server_key_version: "encryptionkey@0"
I20260807 22:42:30.261667 18688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/wal/instance:
uuid: "bb94052ccceb4b36a93d2764c77b2241"
format_stamp: "Formatted at 2026-08-07 22:42:30 on dist-test-slave-8w9v"
server_key: "b815d3efaff35519f37700b08e5b646d"
server_key_iv: "4d732c605a13ed3f21630d209ce8e404"
server_key_version: "encryptionkey@0"
I20260807 22:42:30.265569 18688 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 22:42:30.268397 18704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:30.269886 18688 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 22:42:30.270056 18688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/wal
uuid: "bb94052ccceb4b36a93d2764c77b2241"
format_stamp: "Formatted at 2026-08-07 22:42:30 on dist-test-slave-8w9v"
server_key: "b815d3efaff35519f37700b08e5b646d"
server_key_iv: "4d732c605a13ed3f21630d209ce8e404"
server_key_version: "encryptionkey@0"
I20260807 22:42:30.270193 18688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:30.283308 18688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:30.286724 18688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:30.286952 18688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:30.294565 18688 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.126:46373
I20260807 22:42:30.294891 18760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.126:46373 every 8 connection(s)
I20260807 22:42:30.295598 18688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:30.298486 18761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:30.301486 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 18688
I20260807 22:42:30.301631 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-0/wal/instance
I20260807 22:42:30.301954 26833 external_mini_cluster.cc:1428] Setting key 923ff9c585d97f33d95d2a9aa4714e47
I20260807 22:42:30.302603 18761 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.52.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.125@KRBTEST.COM" created.
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:42:30.319177 18765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.305840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37766 (local address 127.26.52.126:46373)
0807 22:42:30.306170 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.306185 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.306238 (+ 53us) server_negotiation.cc:407] Connection header received
0807 22:42:30.306757 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.306762 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.306953 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.307165 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.308020 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.308986 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.310008 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.310451 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.310626 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.314181 (+ 3555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.314188 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.314199 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.314220 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.315896 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.316491 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.316498 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.316500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.316608 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.316934 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.316937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.316939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.317325 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.317471 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.317871 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.318111 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":201,"thread_start_us":88,"threads_started":1}
I20260807 22:42:30.319177 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.304925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46373 (local address 127.0.0.1:37766)
0807 22:42:30.305435 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.305490 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:30.306440 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:30.307164 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:30.307170 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:30.307621 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:30.307866 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.307881 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.309127 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.309131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.309877 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.309886 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.310611 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.310615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.310778 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.311347 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:30.311366 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:30.314022 (+ 2656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:30.316049 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.316060 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.316070 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.316375 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.316711 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.316714 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.316716 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.316834 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.317451 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:30.317458 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:30.317604 (+ 146us) client_negotiation.cc:769] Sending connection context
0807 22:42:30.317774 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 22:42:30.318166 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":165,"thread_start_us":149,"threads_started":1}
I20260807 22:42:30.321883 18761 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:30.322685 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.322417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40201 (local address 127.0.0.1:42588)
0807 22:42:30.322543 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.322617 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 22:42:30.323020 18708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.52.125:40201: connect: Connection refused (error 111)
I20260807 22:42:30.323886 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.323663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40201 (local address 127.0.0.1:42592)
0807 22:42:30.323773 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.323832 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 22:42:30.324054 18761 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.125:40201: Network error: Client connection negotiation failed: client connection to 127.26.52.125:40201: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab.
Entry for principal kudu/127.26.52.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab.
I20260807 22:42:30.331285 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.125:40201
--webserver_interface=127.26.52.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab
--principal=kudu/127.26.52.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:46373,127.26.52.125:40201,127.26.52.124:41247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:42:30.373364 18761 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } attempt: 1
I20260807 22:42:30.374503 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.374061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40201 (local address 127.0.0.1:42598)
0807 22:42:30.374257 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.374358 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 22:42:30.375391 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.375144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40201 (local address 127.0.0.1:42610)
0807 22:42:30.375280 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.375334 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260807 22:42:30.375545 18761 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.125:40201: Network error: Client connection negotiation failed: client connection to 127.26.52.125:40201: connect: Connection refused (error 111)
I20260807 22:42:30.443728 18761 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } attempt: 2
I20260807 22:42:30.444821 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.444414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40201 (local address 127.0.0.1:42616)
0807 22:42:30.444645 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.444710 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
I20260807 22:42:30.445717 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.445458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40201 (local address 127.0.0.1:42620)
0807 22:42:30.445588 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.445647 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.125:40201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 22:42:30.445896 18761 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.125:40201: Network error: Client connection negotiation failed: client connection to 127.26.52.125:40201: connect: Connection refused (error 111)
W20260807 22:42:30.450096 18768 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:42:30.450381 18768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:30.450430 18768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:30.450519 18768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:30.454838 18768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:30.454895 18768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:30.454914 18768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:30.454931 18768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:30.454985 18768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:30.460536 18768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:46373,127.26.52.125:40201,127.26.52.124:41247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.125.keytab
--principal=kudu/127.26.52.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.125:40201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.52.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:30.461812 18768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:30.462899 18768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:30.472294 18773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:30.472393 18768 server_base.cc:1034] running on GCE node
W20260807 22:42:30.472304 18774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:30.472329 18776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:30.473275 18768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:30.474512 18768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:30.475693 18768 hybrid_clock.cc:648] HybridClock initialized: now 1786142550475682 us; error 29 us; skew 500 ppm
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:30.478688 18768 init.cc:377] Logged in from keytab as kudu/127.26.52.125@KRBTEST.COM (short username kudu)
I20260807 22:42:30.479573 18768 webserver.cc:460] Webserver started at http://127.26.52.125:41077/ using document root <none> and password file <none>
I20260807 22:42:30.480193 18768 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:30.480261 18768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:30.480455 18768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:30.482537 18768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/data/instance:
uuid: "77cc743cca1f4c1591db36745516e0e4"
format_stamp: "Formatted at 2026-08-07 22:42:30 on dist-test-slave-8w9v"
server_key: "107d06c658ac5896b609edf029dc730b"
server_key_iv: "1eb7186f0f8250cf77416a2a2cc12c06"
server_key_version: "encryptionkey@0"
I20260807 22:42:30.483062 18768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/wal/instance:
uuid: "77cc743cca1f4c1591db36745516e0e4"
format_stamp: "Formatted at 2026-08-07 22:42:30 on dist-test-slave-8w9v"
server_key: "107d06c658ac5896b609edf029dc730b"
server_key_iv: "1eb7186f0f8250cf77416a2a2cc12c06"
server_key_version: "encryptionkey@0"
I20260807 22:42:30.487102 18768 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 22:42:30.489825 18784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:30.491235 18768 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:42:30.491413 18768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/wal
uuid: "77cc743cca1f4c1591db36745516e0e4"
format_stamp: "Formatted at 2026-08-07 22:42:30 on dist-test-slave-8w9v"
server_key: "107d06c658ac5896b609edf029dc730b"
server_key_iv: "1eb7186f0f8250cf77416a2a2cc12c06"
server_key_version: "encryptionkey@0"
I20260807 22:42:30.491544 18768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:30.504631 18768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:30.508193 18768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:30.508421 18768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:30.515889 18768 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.125:40201
I20260807 22:42:30.516322 18840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.125:40201 every 8 connection(s)
I20260807 22:42:30.517035 18768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/data/info.pb
I20260807 22:42:30.518895 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 18768
I20260807 22:42:30.519044 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-1/wal/instance
I20260807 22:42:30.519397 26833 external_mini_cluster.cc:1428] Setting key 3a572cec728672bc9c23c7da03f65921
I20260807 22:42:30.520426 18841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:30.524894 18841 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.52.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.52.124@KRBTEST.COM" created.
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
I20260807 22:42:30.537104 18761 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } attempt: 3
I20260807 22:42:30.543017 18765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.527232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37776 (local address 127.26.52.126:46373)
0807 22:42:30.527400 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.527405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.528711 (+ 1306us) server_negotiation.cc:407] Connection header received
0807 22:42:30.529891 (+ 1180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.529896 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.529973 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.530093 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.531632 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.532341 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.534287 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.534689 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.534819 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.537776 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.537781 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.537784 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.537816 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.539810 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.540488 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.540492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.540494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.540586 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.541701 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.541704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.541707 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.541921 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.542048 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.542670 (+ 622us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.542828 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 22:42:30.544060 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.527758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46373 (local address 127.0.0.1:37776)
0807 22:42:30.528507 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.528562 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:30.529642 (+ 1080us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:30.530292 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:30.530301 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:30.530802 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:30.531433 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.531452 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.532544 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.532552 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.534138 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.534150 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.534861 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.534864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.535028 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.535712 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:30.535731 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:30.537516 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:30.539966 (+ 2450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.539973 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.539995 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.540358 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.541418 (+ 1060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.541421 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.541422 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.541577 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.542071 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:30.542081 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:30.542388 (+ 307us) client_negotiation.cc:769] Sending connection context
0807 22:42:30.542601 (+ 213us) client_negotiation.cc:240] Negotiation successful
0807 22:42:30.542955 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":182,"threads_started":1}
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
I20260807 22:42:30.545980 18841 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:30.549966 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.537632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40201 (local address 127.0.0.1:42628)
0807 22:42:30.537874 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.537898 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:30.537988 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:30.538871 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:30.538877 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:30.539076 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:30.539183 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.539188 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.540692 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.540697 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.541282 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.541290 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.542034 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.542038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.542144 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.542713 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:30.542726 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:30.545213 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:30.547857 (+ 2644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.547861 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.547864 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.548239 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.548663 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.548667 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.548669 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.548767 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.549313 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:30.549316 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:30.549433 (+ 117us) client_negotiation.cc:769] Sending connection context
0807 22:42:30.549561 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 22:42:30.549729 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148}
I20260807 22:42:30.550046 18846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.537770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42628 (local address 127.26.52.125:40201)
0807 22:42:30.538298 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.538312 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.538342 (+ 30us) server_negotiation.cc:407] Connection header received
0807 22:42:30.538406 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.538414 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.538658 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.538869 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.539309 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.540553 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.541421 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.541903 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.541991 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.545364 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.545372 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.545385 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.545412 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.547736 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.548362 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.548368 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.548370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.548516 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.548870 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.548906 (+ 36us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.548908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.549192 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.549351 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.549655 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.549815 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":162,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.52.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab.
Entry for principal kudu/127.26.52.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab.
I20260807 22:42:30.551527 26833 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
/tmp/dist-test-taskDuvoCt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.124:41247
--webserver_interface=127.26.52.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab
--principal=kudu/127.26.52.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.52.84:33469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.52.126:46373,127.26.52.125:40201,127.26.52.124:41247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
I20260807 22:42:30.553390 18761 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:30.554358 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.553985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46486)
0807 22:42:30.554169 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.554242 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 22:42:30.555063 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.554809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46488)
0807 22:42:30.554959 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.555009 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260807 22:42:30.555205 18761 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:41247: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
I20260807 22:42:30.555969 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.546596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40201 (local address 127.0.0.1:42644)
0807 22:42:30.546739 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.546759 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:30.546844 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:30.547114 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:30.547118 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:30.547291 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:30.547435 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.547445 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.548340 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.548343 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.548846 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.548853 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.549373 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.549377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.549584 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.550268 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:30.550284 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:30.552024 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:30.554169 (+ 2145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.554174 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.554178 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.554384 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.554954 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.554961 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.554963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.555060 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.555564 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:30.555566 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:30.555647 (+ 81us) client_negotiation.cc:769] Sending connection context
0807 22:42:30.555735 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:42:30.555838 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":54,"spinlock_wait_cycles":768}
I20260807 22:42:30.556335 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.546602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42644 (local address 127.26.52.125:40201)
0807 22:42:30.546910 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.546917 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.546928 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:42:30.546956 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.546958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.546992 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.547063 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.547585 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.548231 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.548959 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.549251 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.549365 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.552223 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.552230 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.552236 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.552267 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.554071 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.554703 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.554709 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.554713 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.554829 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.555169 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.555175 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.555180 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.555452 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.555570 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.555832 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.556000 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":241,"thread_start_us":121,"threads_started":1}
I20260807 22:42:30.556962 18841 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:30.557678 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.557441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46492)
0807 22:42:30.557547 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.557619 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 22:42:30.557932 18788 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
I20260807 22:42:30.558912 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.558696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46506)
0807 22:42:30.558815 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.558858 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 22:42:30.559144 18841 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:41247: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
I20260807 22:42:30.586370 18761 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } attempt: 1
I20260807 22:42:30.587394 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.587031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46512)
0807 22:42:30.587231 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.587305 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260807 22:42:30.588332 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.588044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46528)
0807 22:42:30.588214 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.588267 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 22:42:30.588507 18761 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:41247: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
I20260807 22:42:30.608410 18841 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } attempt: 1
I20260807 22:42:30.609431 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.609075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46534)
0807 22:42:30.609270 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.609342 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 22:42:30.610359 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.610108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46540)
0807 22:42:30.610243 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.610299 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 22:42:30.610536 18841 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:41247: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
I20260807 22:42:30.663702 18761 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } attempt: 2
I20260807 22:42:30.664680 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.664373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46546)
0807 22:42:30.664528 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.664600 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 22:42:30.665473 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.665239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46552)
0807 22:42:30.665351 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.665405 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 22:42:30.665632 18761 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:41247: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
W20260807 22:42:30.674407 18849 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:42:30.674700 18849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:30.674724 18849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:30.674805 18849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 22:42:30.678747 18841 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } attempt: 2
W20260807 22:42:30.679137 18849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:30.679219 18849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:30.679260 18849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:30.679292 18849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:30.679313 18849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:30.679757 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.679395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46554)
0807 22:42:30.679610 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.679675 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260807 22:42:30.680612 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.680393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46570)
0807 22:42:30.680508 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.680555 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 22:42:30.680827 18841 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.52.124:41247: Network error: Client connection negotiation failed: client connection to 127.26.52.124:41247: connect: Connection refused (error 111)
I20260807 22:42:30.685432 18849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.52.84:33469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.52.126:46373,127.26.52.125:40201,127.26.52.124:41247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/krb5kdc/kudu_127.26.52.124.keytab
--principal=kudu/127.26.52.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.52.124:41247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.52.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 22:03:03 UTC on ccycloud.quasar-mvmwel.root.comops.site
build id 4573647
I20260807 22:42:30.686650 18849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:30.687742 18849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:30.696762 18856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:30.696972 18855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:30.697033 18849 server_base.cc:1034] running on GCE node
W20260807 22:42:30.696806 18858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:30.697834 18849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:30.699056 18849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:30.700206 18849 hybrid_clock.cc:648] HybridClock initialized: now 1786142550700171 us; error 52 us; skew 500 ppm
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:30.703049 18849 init.cc:377] Logged in from keytab as kudu/127.26.52.124@KRBTEST.COM (short username kudu)
I20260807 22:42:30.703992 18849 webserver.cc:460] Webserver started at http://127.26.52.124:37559/ using document root <none> and password file <none>
I20260807 22:42:30.704602 18849 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:30.704666 18849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:30.704845 18849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:42:30.706960 18849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/data/instance:
uuid: "05979b88ec0c497582e374c5fa8647e9"
format_stamp: "Formatted at 2026-08-07 22:42:30 on dist-test-slave-8w9v"
server_key: "e306db84267fac9e7704874f21b2b71b"
server_key_iv: "9863742ae4e4064a0739c2029dd97a3e"
server_key_version: "encryptionkey@0"
I20260807 22:42:30.707502 18849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/wal/instance:
uuid: "05979b88ec0c497582e374c5fa8647e9"
format_stamp: "Formatted at 2026-08-07 22:42:30 on dist-test-slave-8w9v"
server_key: "e306db84267fac9e7704874f21b2b71b"
server_key_iv: "9863742ae4e4064a0739c2029dd97a3e"
server_key_version: "encryptionkey@0"
I20260807 22:42:30.711630 18849 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 22:42:30.714244 18865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:30.715549 18849 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:42:30.715690 18849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/data,/tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/wal
uuid: "05979b88ec0c497582e374c5fa8647e9"
format_stamp: "Formatted at 2026-08-07 22:42:30 on dist-test-slave-8w9v"
server_key: "e306db84267fac9e7704874f21b2b71b"
server_key_iv: "9863742ae4e4064a0739c2029dd97a3e"
server_key_version: "encryptionkey@0"
I20260807 22:42:30.715813 18849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:30.730334 18849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:30.733881 18849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:30.734110 18849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:30.741888 18849 rpc_server.cc:307] RPC server started. Bound to: 127.26.52.124:41247
I20260807 22:42:30.742201 18920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.52.124:41247 every 8 connection(s)
I20260807 22:42:30.742987 18849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/data/info.pb
I20260807 22:42:30.746104 18921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:30.750149 18921 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:30.750955 26833 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu as pid 18849
I20260807 22:42:30.751094 26833 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDuvoCt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142258649536-26833-0/minicluster-data/master-2/wal/instance
I20260807 22:42:30.751433 26833 external_mini_cluster.cc:1428] Setting key c92cf1ae0c5586b45d2ead650b989d31
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:42:30.764799 18761 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } attempt: 3
I20260807 22:42:30.766028 18765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.752531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37784 (local address 127.26.52.126:46373)
0807 22:42:30.752680 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.752685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.753717 (+ 1032us) server_negotiation.cc:407] Connection header received
0807 22:42:30.754618 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.754622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.754677 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.754781 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.756293 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.757075 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.758508 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.758857 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.758974 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.761764 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.761767 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.761769 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.761795 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.763429 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.764171 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.764175 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.764181 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.764260 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.764667 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.764670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.764672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.764973 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.765078 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.765716 (+ 638us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.765842 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:42:30.767077 18924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.752896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46572 (local address 127.26.52.124:41247)
0807 22:42:30.753440 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.753460 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.753503 (+ 43us) server_negotiation.cc:407] Connection header received
0807 22:42:30.754358 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.754384 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.754649 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.754836 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.755837 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.757315 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.758508 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.759111 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.759195 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.762170 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.762176 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.762187 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.762208 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.764021 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.764574 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.764579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.764580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.764692 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.765046 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.765051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.765054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.765416 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.766352 (+ 936us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.766461 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.766607 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"spinlock_wait_cycles":5504,"thread_start_us":147,"threads_started":1}
I20260807 22:42:30.767076 18925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.752896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.126:46373 (local address 127.0.0.1:37784)
0807 22:42:30.753553 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.753603 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:30.754360 (+ 757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:30.755391 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:30.755397 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:30.755858 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:30.756079 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.756090 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.757201 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.757204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.758359 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.758369 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.759020 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.759022 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.759177 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.759866 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:30.759887 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:30.761577 (+ 1690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:30.763544 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.763552 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.763562 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.764016 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.764359 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.764363 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.764365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.764565 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.765074 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:30.765082 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:30.765449 (+ 367us) client_negotiation.cc:769] Sending connection context
0807 22:42:30.765670 (+ 221us) client_negotiation.cc:240] Negotiation successful
0807 22:42:30.765993 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"spinlock_wait_cycles":32512,"thread_start_us":174,"threads_started":1}
I20260807 22:42:30.768807 18921 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.126@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:42:30.772004 18841 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } attempt: 3
I20260807 22:42:30.775116 18926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.765360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46574 (local address 127.26.52.124:41247)
0807 22:42:30.765851 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.765860 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.765872 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:42:30.765907 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.765910 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.765958 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.766521 (+ 563us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.766606 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.767348 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.768456 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.768765 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.768883 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.771281 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.771285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.771288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.771315 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.773268 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.773770 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.773775 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.773778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.773861 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.774206 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.774208 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.774209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.774431 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.774539 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.774807 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.774922 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":133,"threads_started":1}
I20260807 22:42:30.775116 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.765271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46574)
0807 22:42:30.765512 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.765529 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:30.765599 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:30.766108 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:30.766114 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:30.766292 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:30.766397 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.766404 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.767507 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.767510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.768322 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.768332 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.768892 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.768896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.768977 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.769591 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:30.769605 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:30.771138 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:30.773386 (+ 2248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.773389 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.773392 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.773646 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.773975 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.773978 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.773980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.774082 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.774539 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:30.774541 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:30.774643 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 22:42:30.774752 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 22:42:30.774905 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.126@KRBTEST.COM
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
I20260807 22:42:30.779832 18761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241: Bootstrap starting.
I20260807 22:42:30.780869 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.769543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42646 (local address 127.26.52.125:40201)
0807 22:42:30.769891 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.769897 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.769911 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:42:30.769956 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.769959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.770007 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.770079 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.770617 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.771420 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.773183 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.773562 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.773647 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.777259 (+ 3612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.777263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.777266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.777299 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.778920 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.779397 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.779400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.779402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.779502 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.779828 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.779831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.779833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.780076 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.780219 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.780550 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.780680 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256}
I20260807 22:42:30.780890 18925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.769422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.125:40201 (local address 127.0.0.1:42646)
0807 22:42:30.769523 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.769539 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:30.769611 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:30.770143 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:30.770149 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:30.770343 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:30.770474 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.770480 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.771532 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.771537 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.773016 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.773031 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.773801 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.773804 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.773981 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.775328 (+ 1347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:30.775348 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:30.777123 (+ 1775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:30.779039 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.779044 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.779047 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.779289 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.779612 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.779618 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.779622 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.779719 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.780271 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:30.780274 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:30.780374 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 22:42:30.780484 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 22:42:30.780627 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 22:42:30.781713 18921 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:42:30.781919 18765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.770293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37798 (local address 127.26.52.126:46373)
0807 22:42:30.770426 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.770432 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.770448 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:42:30.770481 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.770484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.770529 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.770602 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.771390 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.772175 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.773273 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.773604 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.773700 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.777466 (+ 3766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.777469 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.777472 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.777497 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.779152 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.779677 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.779681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.779682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.779766 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.780076 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.780079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.780081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.780333 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.780512 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.781592 (+ 1080us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.781726 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:42:30.783488 18761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:30.784560 18761 log.cc:824] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:30.787000 18761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241: No bootstrap required, opened a new log
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.124@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.52.125@KRBTEST.COM
Aug 07 22:42:30 dist-test-slave-8w9v krb5kdc[18672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142550, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.52.125@KRBTEST.COM for kudu/127.26.52.124@KRBTEST.COM
I20260807 22:42:30.792214 18925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.782200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46600)
0807 22:42:30.782340 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.782364 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:30.782442 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:30.782797 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:30.782800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:30.782978 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:30.783060 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.783066 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.784061 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.784064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.784767 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.784778 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.785348 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.785353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.785435 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.785940 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:30.785955 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:30.787427 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:30.790539 (+ 3112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.790545 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.790550 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.790810 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.791112 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.791116 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.791121 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.791195 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.791655 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:30.791658 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:30.791744 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 22:42:30.791828 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 22:42:30.791977 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 22:42:30.792490 18761 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } }
I20260807 22:42:30.792790 18761 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb94052ccceb4b36a93d2764c77b2241, State: Initialized, Role: FOLLOWER
I20260807 22:42:30.793258 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.783140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42652 (local address 127.26.52.125:40201)
0807 22:42:30.783241 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.783245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.783322 (+ 77us) server_negotiation.cc:407] Connection header received
0807 22:42:30.783455 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.783458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.783498 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.783586 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.784324 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.785002 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.786000 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.786338 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.786474 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.789395 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.789402 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.789408 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.789442 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.791199 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.791678 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.791681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.791683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.791766 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.792097 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.792101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.792103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.792373 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.792569 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.792974 (+ 405us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.793098 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:42:30.793267 18926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.782422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46600 (local address 127.26.52.124:41247)
0807 22:42:30.782527 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.782532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.782545 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:42:30.782585 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.782589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.782636 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.782704 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.783172 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.783938 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.784887 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.785221 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.785659 (+ 438us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.787562 (+ 1903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.787565 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.787568 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.787589 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.790056 (+ 2467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.790928 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.790934 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.790939 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.791017 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.791296 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.791300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.791302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.791546 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.792970 (+ 1424us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.793037 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.793142 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:42:30.793190 18761 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } }
I20260807 22:42:30.793673 18844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.772837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.52.124:41247 (local address 127.0.0.1:46588)
0807 22:42:30.773011 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:30.773024 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:30.773099 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:30.773535 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:30.773538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:30.773729 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:30.773832 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.773838 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.775716 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.775723 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.776650 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:30.776662 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.787769 (+ 11107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.787775 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:30.787897 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.788351 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:30.788365 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:30.789734 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:30.791804 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.791807 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.791809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.792064 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.792503 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:30.792509 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:30.792514 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:30.792610 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:30.793199 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:30.793205 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:30.793302 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 22:42:30.793386 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 22:42:30.793532 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260807 22:42:30.794802 18924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.772722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46588 (local address 127.26.52.124:41247)
0807 22:42:30.773268 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.773272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.773284 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:42:30.773314 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.773316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.773353 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.773937 (+ 584us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.774025 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.775581 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.785038 (+ 9457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.785375 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.787755 (+ 2380us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.789892 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.789895 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.789898 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.789943 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.791669 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.792236 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.792239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.792241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.792320 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.792871 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.792875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.792877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.793081 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.794480 (+ 1399us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.794552 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.794667 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468}
I20260807 22:42:30.794872 18761 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:30.797312 26833 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:42:30.797636 18921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9: Bootstrap starting.
I20260807 22:42:30.797825 18841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4: Bootstrap starting.
I20260807 22:42:30.800609 18921 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:30.798581 18732 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "bb94052ccceb4b36a93d2764c77b2241"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37798
I20260807 22:42:30.800760 18841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:30.800808 18732 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 22:42:30.800931 18732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:30.801689 18841 log.cc:824] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:30.801735 18921 log.cc:824] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:30.802970 18732 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } }
I20260807 22:42:30.804277 18841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4: No bootstrap required, opened a new log
I20260807 22:42:30.804628 18921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9: No bootstrap required, opened a new log
I20260807 22:42:30.807255 18732 leader_election.cc:288] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [CANDIDATE]: Term 1 election: Requested vote from peers 77cc743cca1f4c1591db36745516e0e4 (127.26.52.125:40201), 05979b88ec0c497582e374c5fa8647e9 (127.26.52.124:41247)
I20260807 22:42:30.808707 18841 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } }
I20260807 22:42:30.808823 18921 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } }
I20260807 22:42:30.809072 18921 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05979b88ec0c497582e374c5fa8647e9, State: Initialized, Role: FOLLOWER
I20260807 22:42:30.809088 18841 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77cc743cca1f4c1591db36745516e0e4, State: Initialized, Role: FOLLOWER
I20260807 22:42:30.809424 18921 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } }
I20260807 22:42:30.809499 18841 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } }
I20260807 22:42:30.810863 18921 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:30.811072 18841 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:30.808037 18688 master_runner.cc:186] Error getting master registration for 127.26.52.125:40201: OK, instance_id { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" instance_seqno: 1786142550513828 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:42:30.811446 18688 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:42:30.811851 18894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bb94052ccceb4b36a93d2764c77b2241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "05979b88ec0c497582e374c5fa8647e9"
I20260807 22:42:30.812143 18894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:30.813735 18894 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb94052ccceb4b36a93d2764c77b2241 in term 1.
I20260807 22:42:30.814153 18812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bb94052ccceb4b36a93d2764c77b2241" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "77cc743cca1f4c1591db36745516e0e4"
I20260807 22:42:30.814388 18812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:30.814319 18944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } } }
I20260807 22:42:30.814623 18944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:30.815761 18812 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb94052ccceb4b36a93d2764c77b2241 in term 1.
I20260807 22:42:30.816289 18708 leader_election.cc:302] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77cc743cca1f4c1591db36745516e0e4, bb94052ccceb4b36a93d2764c77b2241; no voters:
I20260807 22:42:30.816416 18945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } } }
I20260807 22:42:30.816530 18945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 22:42:30.818398 18939 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:42:30.818486 18939 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:30.818675 18928 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } } }
I20260807 22:42:30.818781 18928 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:30.818853 18928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:30.818917 18928 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [term 1 LEADER]: Becoming Leader. State: Replica: bb94052ccceb4b36a93d2764c77b2241, State: Running, Role: LEADER
W20260807 22:42:30.818988 18967 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:42:30.819044 18967 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:30.819366 18928 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } }
I20260807 22:42:30.821147 18849 master_runner.cc:263] No leader master found from master 05979b88ec0c497582e374c5fa8647e9
I20260807 22:42:30.821216 18849 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:42:30.821533 18768 master_runner.cc:263] No leader master found from master 77cc743cca1f4c1591db36745516e0e4
I20260807 22:42:30.821625 18768 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:42:30.821800 18968 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb94052ccceb4b36a93d2764c77b2241. Latest consensus state: current_term: 1 leader_uuid: "bb94052ccceb4b36a93d2764c77b2241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } } }
I20260807 22:42:30.821892 18968 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:30.822314 18977 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:30.823243 18977 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:30.829753 18894 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [term 1 FOLLOWER]: Refusing update from remote peer bb94052ccceb4b36a93d2764c77b2241: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:42:30.830107 18812 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [term 1 FOLLOWER]: Refusing update from remote peer bb94052ccceb4b36a93d2764c77b2241: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:42:30.830461 18968 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:42:30.830865 18968 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:42:30.834962 18945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb94052ccceb4b36a93d2764c77b2241. Latest consensus state: current_term: 1 leader_uuid: "bb94052ccceb4b36a93d2764c77b2241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } } }
I20260807 22:42:30.835114 18945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:30.835197 18944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb94052ccceb4b36a93d2764c77b2241. Latest consensus state: current_term: 1 leader_uuid: "bb94052ccceb4b36a93d2764c77b2241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } } }
I20260807 22:42:30.835340 18944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:30.839951 18968 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bb94052ccceb4b36a93d2764c77b2241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } } }
I20260807 22:42:30.840093 18968 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [sys.catalog]: This master's current role is: LEADER
W20260807 22:42:30.840071 18966 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260807 22:42:30.840260 18978 mvcc.cc:205] Tried to move back new op lower bound from 7316039888189358080 to 7316039888159985664. Current Snapshot: MvccSnapshot[applied={T|T < 7316039888189358080}]
W20260807 22:42:30.840371 18966 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:42:30.841207 18944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bb94052ccceb4b36a93d2764c77b2241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } } }
I20260807 22:42:30.841331 18944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:30.841892 18981 mvcc.cc:205] Tried to move back new op lower bound from 7316039888189358080 to 7316039888159985664. Current Snapshot: MvccSnapshot[applied={T|T < 7316039888189358080}]
I20260807 22:42:30.842175 18977 catalog_manager.cc:1347] Generated new cluster ID: e45b6487da6d461c85e86ffd867f51e6
I20260807 22:42:30.842238 18977 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:30.845068 18968 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bb94052ccceb4b36a93d2764c77b2241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } } }
I20260807 22:42:30.845186 18968 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:30.846403 18945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bb94052ccceb4b36a93d2764c77b2241" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb94052ccceb4b36a93d2764c77b2241" member_type: VOTER last_known_addr { host: "127.26.52.126" port: 46373 } } peers { permanent_uuid: "77cc743cca1f4c1591db36745516e0e4" member_type: VOTER last_known_addr { host: "127.26.52.125" port: 40201 } } peers { permanent_uuid: "05979b88ec0c497582e374c5fa8647e9" member_type: VOTER last_known_addr { host: "127.26.52.124" port: 41247 } } }
I20260807 22:42:30.846532 18945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:42:30.856237 18980 mvcc.cc:205] Tried to move back new op lower bound from 7316039888189358080 to 7316039888159985664. Current Snapshot: MvccSnapshot[applied={T|T < 7316039888189358080}]
I20260807 22:42:30.864501 18977 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:30.865732 18977 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:30.880502 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.836054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42662 (local address 127.26.52.125:40201)
0807 22:42:30.836191 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.836196 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.844055 (+ 7859us) server_negotiation.cc:407] Connection header received
0807 22:42:30.848831 (+ 4776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.848834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.848886 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.848940 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.857514 (+ 8574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.858208 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.862433 (+ 4225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.862779 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.862860 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.871921 (+ 9061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.871926 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.871929 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.871961 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.873789 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.877504 (+ 3715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.877507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.877509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.877606 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.878119 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.878123 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.878125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.878395 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.878519 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.880162 (+ 1643us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.880323 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:42:30.881428 18924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.837304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46616 (local address 127.26.52.124:41247)
0807 22:42:30.837414 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.837419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.844433 (+ 7014us) server_negotiation.cc:407] Connection header received
0807 22:42:30.849076 (+ 4643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.849079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.849130 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.849179 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.856595 (+ 7416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.857338 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.865145 (+ 7807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.865510 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.865587 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.869944 (+ 4357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.869949 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.869951 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.869984 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.871721 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.877234 (+ 5513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.877238 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.877240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.877359 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.878881 (+ 1522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.878887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.878890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.879131 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.879251 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.881121 (+ 1870us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.881268 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:42:30.883380 18977 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb94052ccceb4b36a93d2764c77b2241: Generated new TSK 0
I20260807 22:42:30.884434 18977 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:42:30.886253 18765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:30.836555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37800 (local address 127.26.52.126:46373)
0807 22:42:30.836669 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.836673 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.843851 (+ 7178us) server_negotiation.cc:407] Connection header received
0807 22:42:30.847488 (+ 3637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.847492 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.847549 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.847602 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.858373 (+ 10771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.859107 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.863317 (+ 4210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:30.863635 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:30.863718 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:30.874853 (+ 11135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:30.874858 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:30.874862 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:30.874902 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:30.876703 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.879609 (+ 2906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.879613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.879615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.879710 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:30.882716 (+ 3006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:30.882721 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:30.882723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:30.882974 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:30.883109 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:30.886007 (+ 2898us) server_negotiation.cc:299] Negotiation successful
0807 22:42:30.886139 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 22:42:30.914403 18765 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:30.910639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37804 (local address 127.26.52.126:46373)
0807 22:42:30.910786 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.910791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.912991 (+ 2200us) server_negotiation.cc:407] Connection header received
0807 22:42:30.913433 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.913436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.913494 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.913549 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.914234 (+ 685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37804: BlockingRecv error: recv got EOF from 127.0.0.1:37804 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 22:42:30.915807 18924 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:30.911488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46624 (local address 127.26.52.124:41247)
0807 22:42:30.911642 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.911647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.913343 (+ 1696us) server_negotiation.cc:407] Connection header received
0807 22:42:30.915003 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.915006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.915058 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.915108 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.915678 (+ 570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46624: BlockingRecv error: recv got EOF from 127.0.0.1:46624 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260807 22:42:30.917012 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:30.912293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42666 (local address 127.26.52.125:40201)
0807 22:42:30.912410 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.912414 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.914811 (+ 2397us) server_negotiation.cc:407] Connection header received
0807 22:42:30.916229 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.916232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.916297 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.916350 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.916894 (+ 544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42666: BlockingRecv error: recv got EOF from 127.0.0.1:42666 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 22:42:30.922323 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:30.920621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42680 (local address 127.26.52.125:40201)
0807 22:42:30.920733 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.920737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.921248 (+ 511us) server_negotiation.cc:407] Connection header received
0807 22:42:30.921503 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.921506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.921588 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.921640 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.922194 (+ 554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42680: BlockingRecv error: recv got EOF from 127.0.0.1:42680 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 22:42:30.927603 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:30.925945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42690 (local address 127.26.52.125:40201)
0807 22:42:30.926052 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.926056 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.926632 (+ 576us) server_negotiation.cc:407] Connection header received
0807 22:42:30.926823 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.926826 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.926879 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.926931 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.927493 (+ 562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42690: BlockingRecv error: recv got EOF from 127.0.0.1:42690 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 22:42:30.933547 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:30.931928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42692 (local address 127.26.52.125:40201)
0807 22:42:30.932032 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.932035 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.932604 (+ 569us) server_negotiation.cc:407] Connection header received
0807 22:42:30.932797 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.932803 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.932854 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.932905 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.933431 (+ 526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42692: BlockingRecv error: recv got EOF from 127.0.0.1:42692 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 22:42:30.941509 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:30.939738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42696 (local address 127.26.52.125:40201)
0807 22:42:30.939887 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.939891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.940528 (+ 637us) server_negotiation.cc:407] Connection header received
0807 22:42:30.940729 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.940732 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.940785 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.940837 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.941391 (+ 554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42696: BlockingRecv error: recv got EOF from 127.0.0.1:42696 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260807 22:42:30.953617 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:30.951826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42700 (local address 127.26.52.125:40201)
0807 22:42:30.951948 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.951952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.952602 (+ 650us) server_negotiation.cc:407] Connection header received
0807 22:42:30.952803 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.952806 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.952862 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.952916 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.953484 (+ 568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42700: BlockingRecv error: recv got EOF from 127.0.0.1:42700 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 22:42:30.974221 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:30.972277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42706 (local address 127.26.52.125:40201)
0807 22:42:30.972424 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:30.972430 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:30.973093 (+ 663us) server_negotiation.cc:407] Connection header received
0807 22:42:30.973312 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:30.973316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:30.973383 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:30.973441 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:30.974098 (+ 657us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42706: BlockingRecv error: recv got EOF from 127.0.0.1:42706 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 22:42:31.011945 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:31.009037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42714 (local address 127.26.52.125:40201)
0807 22:42:31.009176 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:31.009182 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:31.009861 (+ 679us) server_negotiation.cc:407] Connection header received
0807 22:42:31.011026 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:31.011030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:31.011093 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:31.011147 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:31.011806 (+ 659us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42714: BlockingRecv error: recv got EOF from 127.0.0.1:42714 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 22:42:31.080086 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:31.078744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42720 (local address 127.26.52.125:40201)
0807 22:42:31.078954 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:31.078959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:31.079110 (+ 151us) server_negotiation.cc:407] Connection header received
0807 22:42:31.079300 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:31.079309 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:31.079360 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:31.079456 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:31.079955 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42720: BlockingRecv error: recv got EOF from 127.0.0.1:42720 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
W20260807 22:42:31.212093 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:31.210604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42732 (local address 127.26.52.125:40201)
0807 22:42:31.210818 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:31.210825 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:31.210973 (+ 148us) server_negotiation.cc:407] Connection header received
0807 22:42:31.211171 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:31.211175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:31.211250 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:31.211339 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:31.211931 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42732: BlockingRecv error: recv got EOF from 127.0.0.1:42732 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
W20260807 22:42:31.472196 18847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:42:31.470917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42740 (local address 127.26.52.125:40201)
0807 22:42:31.471066 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:31.471073 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:31.471159 (+ 86us) server_negotiation.cc:407] Connection header received
0807 22:42:31.471393 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:31.471396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:31.471446 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:31.471541 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:31.472025 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42740: BlockingRecv error: recv got EOF from 127.0.0.1:42740 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:42:31.820562 18967 catalog_manager.cc:1259] Loaded cluster ID: e45b6487da6d461c85e86ffd867f51e6
I20260807 22:42:31.820670 18967 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9: loading cluster ID for follower catalog manager: success
I20260807 22:42:31.822646 18967 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9: acquiring CA information for follower catalog manager: success
I20260807 22:42:31.823822 18967 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 05979b88ec0c497582e374c5fa8647e9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:42:31.841881 18966 catalog_manager.cc:1259] Loaded cluster ID: e45b6487da6d461c85e86ffd867f51e6
I20260807 22:42:31.841990 18966 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4: loading cluster ID for follower catalog manager: success
I20260807 22:42:31.843611 18966 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4: acquiring CA information for follower catalog manager: success
I20260807 22:42:31.844878 18966 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 77cc743cca1f4c1591db36745516e0e4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:42:31.990585 19058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:31.986522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42742 (local address 127.26.52.125:40201)
0807 22:42:31.986782 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:31.986788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:31.986887 (+ 99us) server_negotiation.cc:407] Connection header received
0807 22:42:31.987065 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:31.987073 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:31.987204 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:31.987367 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:31.987623 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:31.988182 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:31.989065 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:31.989302 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:31.989417 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:31.989744 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:31.990180 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:31.990328 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:31.990365 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 22:42:31.990420 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":74,"threads_started":1}
I20260807 22:42:31.997810 19064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:31.993596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46630 (local address 127.26.52.124:41247)
0807 22:42:31.993881 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:31.993885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:31.993898 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:42:31.994034 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:31.994036 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:31.994145 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:31.994250 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:31.994477 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:31.994993 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:31.996102 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:31.996486 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:31.996579 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:31.996940 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:31.997395 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:31.997492 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:31.997560 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 22:42:31.997609 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":79,"threads_started":1}
I20260807 22:42:32.005676 19058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:32.001436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42744 (local address 127.26.52.125:40201)
0807 22:42:32.001560 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:32.001564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:32.002052 (+ 488us) server_negotiation.cc:407] Connection header received
0807 22:42:32.002175 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:32.002178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:32.002230 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:32.002293 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:32.002726 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:32.003481 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:32.004482 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:32.004784 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:32.004884 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:32.005107 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:32.005192 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:32.005262 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:32.005439 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 22:42:32.005497 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:42:32.005882 19064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:32.001847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46632 (local address 127.26.52.124:41247)
0807 22:42:32.001949 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:32.001952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:32.002274 (+ 322us) server_negotiation.cc:407] Connection header received
0807 22:42:32.002432 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:32.002435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:32.002486 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:32.002534 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:32.002858 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:32.003352 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:32.004665 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:32.004985 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:32.005094 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:32.005381 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:32.005453 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:32.005520 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:32.005683 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 22:42:32.005749 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 22:42:32.006836 19070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:32.001419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37810 (local address 127.26.52.126:46373)
0807 22:42:32.001667 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:32.001673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:32.001979 (+ 306us) server_negotiation.cc:407] Connection header received
0807 22:42:32.002093 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:32.002097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:32.002259 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:32.002377 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:32.002599 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:32.003443 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:32.005165 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:32.005535 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:32.005644 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:32.006091 (+ 447us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:32.006423 (+ 332us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:32.006537 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:32.006621 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 22:42:32.006684 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":62,"threads_started":1}
I20260807 22:42:32.010149 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 18688
I20260807 22:42:32.020812 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 18768
I20260807 22:42:32.029060 26833 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDuvoCt/build/debug/bin/kudu with pid 18849
2026-08-07T22:42:32Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3135 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6386 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (293364 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST